-- Logs begin at Wed 2021-09-15 03:46:00 UTC, end at Wed 2021-09-15 04:38:21 UTC. -- Sep 15 04:14:27.731246 dv-cinder-760153-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 04:14:27.739631 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 15 04:14:27 2021] *** Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: nodename: dv-cinder-760153-12-iscsi Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: machine: x86_64 Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: clock source: unix Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: pcre jit disabled Sep 15 04:14:27.741593 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: detected number of CPU cores: 4 Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: current working directory: / Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: detected binary path: /usr/bin/uwsgi-core Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: your processes number limit is 47680 Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: your memory page size is 4096 bytes Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: detected max file descriptor number: 2048 Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: lock engine: pthread robust mutexes Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: thunder lock: enabled Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 04:14:27.742139 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 15 04:14:27.787454 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: Python main interpreter initialized at 0x564bf84179c0 Sep 15 04:14:27.787454 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: python threads support enabled Sep 15 04:14:27.787454 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: your server socket listen backlog is limited to 100 connections Sep 15 04:14:27.787454 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: your mercy for graceful operations on workers is 90 seconds Sep 15 04:14:27.787810 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 04:14:27.787894 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: *** Operational MODE: preforking *** Sep 15 04:14:27.788148 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: *** uWSGI is running in multiple interpreter mode *** Sep 15 04:14:27.788148 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: spawned uWSGI master process (pid: 93195) Sep 15 04:14:27.788350 dv-cinder-760153-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 04:14:27.789451 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: spawned uWSGI worker 1 (pid: 93196, cores: 1) Sep 15 04:14:27.789451 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: spawned uWSGI worker 2 (pid: 93197, cores: 1) Sep 15 04:14:27.789451 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 04:14:29.444564 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:14:29.444564 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: from cryptography.utils import int_from_bytes Sep 15 04:14:29.445109 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:14:29.445109 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: from cryptography.utils import int_from_bytes Sep 15 04:14:29.451358 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:14:29.451358 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: from cryptography.utils import int_from_bytes Sep 15 04:14:29.451867 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:14:29.451867 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: from cryptography.utils import int_from_bytes Sep 15 04:14:32.165843 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 04:14:32.166439 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 04:14:32.166538 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 04:14:32.166905 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 04:14:32.167177 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 04:14:32.167569 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.167898 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.168224 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.168543 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.168872 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.169182 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.169502 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.169819 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.170146 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.170405 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.170718 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.171042 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760153-12-iscsi {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.171398 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.171708 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.172019 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.172334 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.172637 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.172957 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.173264 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.173762 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.174385 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.174679 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.175060 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.175346 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.175662 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.175973 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.176296 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.176606 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.176932 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.177252 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.177640 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760153-12-iscsi {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.177957 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.178271 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.178586 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.179000 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.179339 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.179653 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.179976 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.180299 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.180607 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.180704 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 04:14:32.181083 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 04:14:32.181151 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.181233 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.181360 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 04:14:32.181545 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.181722 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 04:14:32.181865 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.181994 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 04:14:32.182168 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.182368 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.182478 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.182698 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.182783 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183024 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183119 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183379 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183466 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183711 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183820 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.183961 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184048 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184267 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184352 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184589 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184673 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184908 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.184994 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185188 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185272 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185478 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185571 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185730 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.185817 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760153-12-iscsi {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.186047 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.186140 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.186622 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.186724 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.186931 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187017 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187264 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187371 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187576 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187662 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187886 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.187982 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.188194 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.188288 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.188500 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.188695 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.188794 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.189007 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.189102 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.189312 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.189398 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.189731 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190055 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190163 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190364 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190530 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190683 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.190851 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191080 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191297 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191382 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191508 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191643 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191820 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.191979 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192150 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192299 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192465 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192608 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192861 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760153-12-iscsi {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.192957 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193179 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193264 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193494 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193586 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193806 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.193893 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194118 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194210 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194438 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194531 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194762 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.194856 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195066 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195184 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195347 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195444 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195650 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195764 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.195956 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196093 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196276 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196416 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196586 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196739 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.196893 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197059 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197202 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197364 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197501 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197675 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.197988 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198115 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198310 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198425 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198618 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198732 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.198926 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199041 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199201 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199369 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199516 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199676 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199838 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.199979 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200162 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200281 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200487 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200600 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200744 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.200921 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201014 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201228 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201320 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201535 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201632 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201840 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.201928 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202145 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202240 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202465 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202564 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202771 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.202858 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203078 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203193 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203417 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203514 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203719 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.203804 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204026 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204112 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204340 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204438 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204648 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204734 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.204955 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.205042 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.205899 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.206209 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.206362 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.206519 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.206700 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.206837 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207105 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207243 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207389 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207475 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207706 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.207838 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208046 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208131 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208350 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208438 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208656 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208748 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.208958 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209051 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209259 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209345 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209559 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209645 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209877 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.209969 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210190 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210276 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210496 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210580 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210805 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.210899 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211108 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211222 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211385 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211483 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211691 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.211787 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.212001 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.212086 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.212321 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.212414 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.212632 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.212717 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.212943 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.213029 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.213254 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.213352 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.213556 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.213651 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.213868 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.213960 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.214178 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.214275 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.214488 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.214574 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.214798 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.214882 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.215108 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.215230 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.215438 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.215532 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.215749 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.215841 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.216063 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.216150 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.216368 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.216454 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.216687 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.216772 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.217009 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.217095 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.217317 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.217409 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.217624 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.217715 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.217931 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.218017 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.218240 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.218336 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.218560 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.218646 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.218869 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.218956 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.219200 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.219303 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.219527 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.219614 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.219833 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.219926 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.220138 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.220223 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.220458 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.220574 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.220827 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.221429 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.221653 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.222057 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.222146 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.222380 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.222467 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.222699 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.222804 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.223018 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.223108 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.223360 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.223455 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.223694 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.223779 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.224005 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.224090 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.224319 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.224408 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.224620 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.224704 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.224924 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.225008 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.225231 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.225326 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.225539 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.225624 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.225842 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.225926 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.226149 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.226242 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.226470 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.226562 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.226775 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.226859 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.227090 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.227188 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.227426 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.227511 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.227734 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.227819 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228043 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228136 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:14:32.228349 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228435 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228663 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228757 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.228974 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229059 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229279 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229363 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229604 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229698 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.229915 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230001 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230222 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230314 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230546 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230641 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230853 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.230946 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231175 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231265 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231491 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231592 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231804 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.231899 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232117 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232214 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232429 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232516 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232751 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.232844 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233066 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233152 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233379 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233471 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233700 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.233784 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234023 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234108 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234328 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234421 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234648 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234732 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.234977 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235061 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235326 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235450 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235649 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235761 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.235992 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.236092 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.236372 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.236522 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.236799 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237111 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237250 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237424 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237564 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237732 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.237886 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238040 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238215 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238346 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238537 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238654 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238860 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.238958 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239204 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239306 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239531 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239617 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239851 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.239938 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240171 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240268 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240476 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240564 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240815 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.240905 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241122 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241208 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241434 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241519 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241744 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.241829 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242052 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242178 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242365 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242452 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242674 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242760 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.242995 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243082 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243332 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243419 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243649 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243734 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.243963 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244051 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244276 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244362 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244590 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244684 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244900 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.244984 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245205 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245289 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245522 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245621 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245840 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.245925 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246148 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246241 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246470 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246563 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246778 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.246864 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247083 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247181 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247433 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247535 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247742 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.247830 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248050 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248135 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248366 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248461 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248679 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248765 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.248995 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249079 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249305 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249405 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249620 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249715 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.249933 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250019 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250245 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250330 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250564 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250648 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250875 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.250961 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251221 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251323 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251537 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251632 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251862 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.251950 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.252209 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.252547 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.252733 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.252828 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253003 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253143 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253324 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253472 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253637 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253806 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.253949 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254220 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254314 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254539 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254636 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254858 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.254951 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.255192 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.255497 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.255585 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.255810 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256055 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256149 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256430 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256626 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256744 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.256964 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.257057 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.257351 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.257493 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.257659 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258005 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258092 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258315 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258583 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258676 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.258988 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.259188 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.259346 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.259659 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.259753 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.259979 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260063 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260299 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260391 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260613 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260725 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.260930 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.261175 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.261268 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.261546 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.261727 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.261873 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262190 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262277 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262515 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262603 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262830 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.262924 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263185 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263276 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263507 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263593 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263834 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.263922 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264146 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264240 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264466 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264567 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264786 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.264882 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265103 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265189 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265418 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265511 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265728 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.265815 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266067 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266159 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266382 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266475 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266698 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.266814 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.267010 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.267122 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.267363 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.268147 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.268255 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.268687 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.268952 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269045 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269291 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269387 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269615 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269702 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.269933 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270019 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270247 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270341 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270563 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270651 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270879 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.270966 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271221 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271324 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271536 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271623 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271859 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.271946 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272168 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272262 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272484 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272569 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272798 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.272885 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273108 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273195 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273423 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273516 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273740 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.273826 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274058 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274315 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274401 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274652 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274738 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.274962 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275159 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275305 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275392 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275625 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275711 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.275942 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276042 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276264 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276358 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276573 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276661 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276891 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.276987 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277196 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277281 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277503 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277587 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277811 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.277904 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278120 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278206 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278434 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278558 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278744 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.278831 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279053 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279161 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279388 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279486 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279699 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.279786 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280005 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280090 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280313 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280399 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280624 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280710 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.280929 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281027 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281233 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281326 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281538 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281635 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281852 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.281938 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282159 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282246 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282467 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282561 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282780 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.282865 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.283087 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.283218 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.284094 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.284292 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.284569 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.284656 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.284909 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285042 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285239 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285328 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285562 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285648 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285895 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.285981 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286209 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286303 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286516 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286603 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286840 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.286926 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287163 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287252 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287478 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287576 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287785 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.287872 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288099 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288187 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288409 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288503 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288716 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.288812 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289030 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289116 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289339 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289437 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289649 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289744 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.289958 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290046 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290263 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290527 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290613 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290864 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.290950 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291206 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291292 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291519 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291605 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291826 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.291925 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292130 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292217 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292439 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292534 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292748 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.292835 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293051 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293137 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293362 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293461 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293667 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293754 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.293985 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294069 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294288 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294381 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294593 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294679 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294896 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.294982 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295227 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295330 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295538 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295622 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295841 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.295933 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296152 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296246 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296461 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296554 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296764 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.296856 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297071 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297166 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297373 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297459 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297678 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297764 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.297989 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298075 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298294 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298380 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298616 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298701 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.298955 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.299053 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.299291 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.299599 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.299888 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.299974 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300195 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300353 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300502 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300590 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300805 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.300891 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301107 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301207 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301409 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301502 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301711 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.301797 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302015 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302139 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302337 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302454 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302646 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302767 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.302951 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303099 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303281 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303437 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303586 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303749 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.303927 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304060 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304230 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304377 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304590 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304683 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304899 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.304986 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305215 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305301 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305540 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305626 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305854 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.305941 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306165 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306251 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306480 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306566 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306786 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.306873 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307092 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307197 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307430 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307527 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307740 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.307834 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308043 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308128 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308349 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308444 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308665 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308751 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.308978 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309065 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309283 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309413 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309598 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309685 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309906 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.309999 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310226 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310320 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310532 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310618 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310840 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.310926 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.311182 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.311546 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.311744 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.311831 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312055 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312141 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312363 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312449 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312676 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312762 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.312989 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313074 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313298 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313392 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313609 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313702 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.313915 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314000 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314220 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314306 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314590 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314716 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.314952 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.315293 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.315471 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.315625 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.315801 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.315937 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.316115 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.316326 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.316435 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.316640 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.316754 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317063 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317149 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317372 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317655 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317741 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.317980 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.318208 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.318297 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.318579 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.318769 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.318884 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.319217 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.319393 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.319545 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.319856 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.319951 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.320165 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.320472 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.320572 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.320781 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321062 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321151 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321419 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321504 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321783 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.321915 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.322092 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.322179 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.322411 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.322503 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.322735 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.323052 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.323240 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.323412 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.323710 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.323796 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324041 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324148 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324347 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324436 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324664 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324756 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.324977 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325070 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325282 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325375 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325591 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325686 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.325917 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326012 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326228 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326314 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326542 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326627 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326866 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.326959 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327199 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327288 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327530 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327628 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327838 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.327958 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.328153 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.328278 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.328470 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.328592 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.328783 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329017 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329148 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329404 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329551 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329713 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.329809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.330031 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.330685 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.330990 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.331356 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.331498 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.331677 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.331793 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.331999 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332116 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332316 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332480 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332648 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332734 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.332981 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333069 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333301 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333400 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333623 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333717 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.333936 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334022 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334259 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334354 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334576 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334662 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334888 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.334975 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.335235 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.335343 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.335549 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.335637 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.335974 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336066 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336290 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336377 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336607 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336700 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.336920 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337005 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337229 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337315 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337540 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337639 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337855 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.337941 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338165 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338252 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338472 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338557 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338797 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.338881 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339104 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339255 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339456 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339554 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339774 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.339870 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340084 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340173 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340394 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340480 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340700 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.340795 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341025 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341111 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341328 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341413 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341634 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341731 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.341943 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342041 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342267 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342361 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342578 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342672 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342885 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.342978 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343235 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343325 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343551 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343716 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343862 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.343962 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344169 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344331 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344477 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344645 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344821 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.344959 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.345129 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.345286 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.345452 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.345610 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.346390 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.346678 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.346996 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347085 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347336 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347423 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347668 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347757 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.347986 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348072 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348305 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348432 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348631 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348718 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.348938 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349030 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349247 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349343 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349555 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349642 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349861 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.349945 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350168 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350263 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350476 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350563 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350788 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.350882 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351092 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351278 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351492 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351581 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351798 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.351885 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352124 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352220 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352433 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352530 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352757 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.352844 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353069 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353164 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353376 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353471 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353683 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353768 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.353987 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354084 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354313 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354399 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354624 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354712 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.354942 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355030 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355285 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355375 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355597 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355684 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355906 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.355995 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356212 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356299 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356540 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356628 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356848 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.356936 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357164 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357250 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357482 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357575 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357798 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.357885 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358116 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358203 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358422 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358546 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358744 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.358830 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359054 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359155 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359399 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359494 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359706 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.359792 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360015 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360100 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360358 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360545 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360678 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360877 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.360991 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.361194 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.361324 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.361663 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362126 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362212 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362474 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362561 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362799 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.362899 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363117 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363254 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363456 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363543 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363773 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.363863 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364090 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364176 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364424 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364517 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364735 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.364822 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365052 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365140 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365362 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365456 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365671 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365759 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.365983 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366061 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366297 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366397 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366605 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366698 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.366913 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367007 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367243 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367346 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367610 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367709 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367883 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.367970 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368201 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368296 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368515 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368626 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368830 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.368928 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369137 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369233 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369452 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369558 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369757 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.369845 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370071 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370170 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370380 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370475 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370697 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.370784 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371012 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371107 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371363 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371453 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371677 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.371763 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372005 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372100 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372319 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372404 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372636 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372731 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.372953 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373039 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373275 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373476 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373611 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373795 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.373884 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.374130 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.374216 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.374456 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.374543 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.374782 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.375097 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.375215 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.375442 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.375557 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.377864 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378013 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378105 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378187 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378267 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378267 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378429 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378511 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378607 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378697 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378697 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378839 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.378936 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379019 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379094 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379196 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379264 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379330 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379409 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379478 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379478 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379595 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379660 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.379927 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380093 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380257 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380427 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380580 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380758 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.380914 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381082 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381256 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381396 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381580 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381727 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.381901 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382040 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382220 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382350 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382618 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382713 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.382968 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.383303 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.383394 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.383611 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.383927 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.384017 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.384239 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.384503 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.384589 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.384898 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385000 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385156 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385242 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385485 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385570 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385799 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.385894 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386109 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386194 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386417 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386503 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386732 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.386819 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387042 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387145 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387393 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387489 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387702 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.387788 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388137 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388230 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388331 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388417 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388640 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388728 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.388953 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389041 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389262 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389348 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389578 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389665 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.389903 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.390016 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.390446 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.390555 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.390767 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.391012 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.391318 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.391414 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.391680 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.391925 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.392029 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.392305 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.392532 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.393143 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.393475 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.393762 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.393861 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.394101 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.394291 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.394451 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.394775 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.394937 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.395075 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.395425 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.395514 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.395751 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.395857 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396276 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396370 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396458 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396539 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396707 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.396864 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397026 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397181 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397341 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397496 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397668 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.397992 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.398136 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.398453 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.398538 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.398769 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.398865 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399082 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399228 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399429 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399516 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399745 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.399834 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400059 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400162 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400375 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400472 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400687 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.400777 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401070 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401214 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401383 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401559 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401701 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.401887 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.402016 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.402211 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.402327 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.402530 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.402625 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403258 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403366 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403441 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403511 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403596 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403777 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.403881 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404098 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404192 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404404 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404510 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404745 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.404841 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405060 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405147 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405370 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405467 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405684 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.405774 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406006 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406101 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406318 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406493 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406630 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406718 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.406946 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407039 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407280 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407375 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407598 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407703 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.407914 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.408009 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.408368 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.408952 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.409366 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.409709 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.409808 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410078 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410187 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410523 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410630 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410702 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.410930 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411020 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411101 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411354 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411445 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411663 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411757 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.411976 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.412069 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.412315 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.412407 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413087 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413174 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413246 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413246 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413558 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413676 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.413867 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.414190 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.414314 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.414514 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.414647 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.414833 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.415012 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.415172 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.415366 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.415501 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.415817 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.416175 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.416456 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.416719 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.416809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.417068 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.417154 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.417381 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.417478 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.417715 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418045 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418130 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418352 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418679 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418900 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.418989 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.419264 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.419352 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.419591 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.419690 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.419913 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.420001 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.420264 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.420644 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.420901 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421033 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421215 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421370 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421528 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421698 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.421846 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422024 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422164 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422348 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422491 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422736 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.422833 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423017 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423113 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423331 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423468 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423650 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.423816 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.424161 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.424506 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.424830 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.424920 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.425073 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93196) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 04:14:32.425195 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.425519 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.425857 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.426187 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.426520 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.426848 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.427195 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.427521 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.427844 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.428172 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.428514 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.428838 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.429152 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.429587 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.429909 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.430238 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.430570 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.430890 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.431241 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.431582 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.431905 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.432235 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.432556 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.432891 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.433240 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.433575 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.433906 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.434219 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.434532 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.434843 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.435177 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.435520 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.435841 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.436167 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.436737 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.437064 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.437378 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.437702 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.438029 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.438352 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.438667 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.439004 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.439350 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.440701 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.441038 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.441355 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.441674 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.441997 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.442334 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.442667 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.442985 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.443643 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.444257 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.444582 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.444910 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.445231 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.445570 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.445893 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.446220 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.446541 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.446860 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.447208 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.447533 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.447867 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.448197 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.448306 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.448529 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.448862 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.449218 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.449539 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.449891 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.450224 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:14:32.450509 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93197) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 04:14:32.473187 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.621017 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.context [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9(cell1) {{(pid=93196) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 04:14:32.625521 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_concurrency.lockutils [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:32.627718 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_concurrency.lockutils [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:32.628575 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_concurrency.lockutils [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:32.630532 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_concurrency.lockutils [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93196) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:32.641469 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.644439 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.654528 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.context [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9(cell1) {{(pid=93197) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 04:14:32.659722 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:32.661304 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:32.662123 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:14:32.664081 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:14:32.676327 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.678585 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.904595 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG oslo_db.sqlalchemy.engines [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93196) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:32.946230 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_db.sqlalchemy.engines [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93197) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:14:33.246605 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: WARNING keystonemiddleware.auth_token [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:14:33.253642 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: WARNING keystonemiddleware.auth_token [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:14:33.269707 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: WARNING keystonemiddleware.auth_token [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:14:33.276344 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: WARNING keystonemiddleware.auth_token [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:14:33.597795 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: WARNING keystonemiddleware.auth_token [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:14:33.602857 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: WARNING keystonemiddleware.auth_token [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:14:33.609021 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bf84179c0 pid: 93196 (default app) Sep 15 04:14:33.611095 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:14:33.612906 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] 10.222.0.37 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002361 Sep 15 04:14:33.613315 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 1/1] 10.222.0.37 () {50 vars in 789 bytes} [Wed Sep 15 04:14:33 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:14:33.622383 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: WARNING keystonemiddleware.auth_token [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:14:33.628342 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: WARNING keystonemiddleware.auth_token [None req-dc8c2683-e02f-455a-88aa-b76923b98d1d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:14:33.633581 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564bf84179c0 pid: 93197 (default app) Sep 15 04:15:53.782742 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:15:53.783767 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Sep 15 04:15:53.784165 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 2/2] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:15:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:15:54.206443 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-dc546912-5885-4c99-9be1-ae52134b92ca admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:15:54.236085 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-dc546912-5885-4c99-9be1-ae52134b92ca admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444458 Sep 15 04:15:54.236858 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 1/3] 10.222.0.37 () {60 vars in 1292 bytes} [Wed Sep 15 04:15:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:15:56.482941 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:15:56.485132 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-0cfa3c01-3a5c-4495-9bb2-f78f7a486894 None None] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 Sep 15 04:15:56.486163 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 3/4] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:15:56 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:15:56.549764 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-7310de03-496f-4159-a3d7-2b78a43d939d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:15:56.568766 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:15:56.568766 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:15:56.598972 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-7310de03-496f-4159-a3d7-2b78a43d939d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105576 Sep 15 04:15:56.599563 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 2/5] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:15:56 2021] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:15:56.823685 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-aa5413ab-78b2-4b19-b339-83c895b354d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:15:56.826316 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:15:56.826316 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: warnings.warn(msg) Sep 15 04:15:56.875120 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-aa5413ab-78b2-4b19-b339-83c895b354d7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.266268 Sep 15 04:15:56.875936 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 4/6] 10.222.0.37 () {64 vars in 1336 bytes} [Wed Sep 15 04:15:56 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:15:59.115593 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-7310de03-496f-4159-a3d7-2b78a43d939d admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:15:59.116603 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-7310de03-496f-4159-a3d7-2b78a43d939d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Sep 15 04:15:59.117004 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 3/7] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:15:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:15:59.229480 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-de557504-5c73-4c5d-a6a9-a955591566a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:15:59.247579 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:15:59.247579 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: warnings.warn(msg) Sep 15 04:15:59.266632 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-de557504-5c73-4c5d-a6a9-a955591566a7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143242 Sep 15 04:15:59.267345 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 5/8] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:15:59 2021] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:15:59.279443 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-cfa81bff-bb6b-41b1-adea-dea742fb6b82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:15:59.281886 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:15:59.281886 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:15:59.313613 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-cfa81bff-bb6b-41b1-adea-dea742fb6b82 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037755 Sep 15 04:15:59.314241 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 4/9] 10.222.0.37 () {64 vars in 1336 bytes} [Wed Sep 15 04:15:59 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:16:01.548838 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-de557504-5c73-4c5d-a6a9-a955591566a7 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:01.550253 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-de557504-5c73-4c5d-a6a9-a955591566a7 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Sep 15 04:16:01.550913 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 6/10] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:01.612241 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-59116401-046d-4ec2-9140-ed925dd7d458 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds1G"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:01.633698 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-59116401-046d-4ec2-9140-ed925dd7d458 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076193 Sep 15 04:16:01.634266 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 5/11] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:01.647841 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-3974dff0-263c-4d68-a830-f6ed9467a85e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:01.673184 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-3974dff0-263c-4d68-a830-f6ed9467a85e admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029178 Sep 15 04:16:01.675893 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 7/12] 10.222.0.37 () {64 vars in 1336 bytes} [Wed Sep 15 04:16:01 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:16:03.946307 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-59116401-046d-4ec2-9140-ed925dd7d458 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:03.947358 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-59116401-046d-4ec2-9140-ed925dd7d458 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 15 04:16:03.947766 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 6/13] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:04.009180 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-abcbba75-c14a-4b4f-97dd-1425a1d206bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:04.029915 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-abcbba75-c14a-4b4f-97dd-1425a1d206bc admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074968 Sep 15 04:16:04.031534 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 8/14] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:04.048335 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-87a32a95-a67a-4cf4-ab86-0f5c36908d30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:04.079063 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-87a32a95-a67a-4cf4-ab86-0f5c36908d30 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034745 Sep 15 04:16:04.079679 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 7/15] 10.222.0.37 () {64 vars in 1336 bytes} [Wed Sep 15 04:16:04 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:16:06.333063 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-abcbba75-c14a-4b4f-97dd-1425a1d206bc admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:06.334071 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-abcbba75-c14a-4b4f-97dd-1425a1d206bc admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 15 04:16:06.334478 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 9/16] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:06.395151 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "id": "d4"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:06.415166 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074254 Sep 15 04:16:06.415954 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 8/17] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:06.429219 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-d1769e5d-c712-45a8-b1e7-df7abe60e873 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:06.454016 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-d1769e5d-c712-45a8-b1e7-df7abe60e873 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029010 Sep 15 04:16:06.454850 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 10/18] 10.222.0.37 () {64 vars in 1336 bytes} [Wed Sep 15 04:16:06 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:16:08.684166 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:08.685354 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Sep 15 04:16:08.685745 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 9/19] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:08.745772 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-f9d0e8a7-7c81-444a-8776-b8981331ca0d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:08.769955 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-f9d0e8a7-7c81-444a-8776-b8981331ca0d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076366 Sep 15 04:16:08.770959 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 11/20] 10.222.0.37 () {60 vars in 1292 bytes} [Wed Sep 15 04:16:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:16:11.043193 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:11.044232 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-3ae19a6b-1299-4843-a76c-ebab4b8a7555 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Sep 15 04:16:11.044631 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 10/21] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:11.110651 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-d1439658-9db8-4f92-8684-1e2e8c5bbea6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:11.133173 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-d1439658-9db8-4f92-8684-1e2e8c5bbea6 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080752 Sep 15 04:16:11.134022 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 12/22] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:11 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:16:11.148852 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-4b8de06b-0489-4c44-a298-eccf8c545b81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:11.171534 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-4b8de06b-0489-4c44-a298-eccf8c545b81 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026235 Sep 15 04:16:11.172251 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 11/23] 10.222.0.37 () {64 vars in 1333 bytes} [Wed Sep 15 04:16:11 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:16:13.431591 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-d1439658-9db8-4f92-8684-1e2e8c5bbea6 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:13.432823 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-d1439658-9db8-4f92-8684-1e2e8c5bbea6 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001920 Sep 15 04:16:13.433370 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 13/24] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:13 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:13.495178 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-a0ba957d-0894-4142-931c-14d24eccf534 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "name": "m1.small", "id": "2", "ram": 2048, "vcpus": 1}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:13.513256 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-a0ba957d-0894-4142-931c-14d24eccf534 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071619 Sep 15 04:16:13.513811 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 12/25] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:13.528567 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-405a0b84-3e6e-40ee-9243-5b440932f11a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:13.554430 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-405a0b84-3e6e-40ee-9243-5b440932f11a admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030630 Sep 15 04:16:13.554965 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 14/26] 10.222.0.37 () {64 vars in 1333 bytes} [Wed Sep 15 04:16:13 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:16:15.766806 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-a0ba957d-0894-4142-931c-14d24eccf534 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:15.767860 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-a0ba957d-0894-4142-931c-14d24eccf534 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 15 04:16:15.768438 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 13/27] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:15.827524 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-2a609b17-2e46-4a97-917a-52b4fe5e83e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:15.845367 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-2a609b17-2e46-4a97-917a-52b4fe5e83e5 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070853 Sep 15 04:16:15.845923 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 15/28] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:15 2021] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:15.858490 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-c3ffc392-d690-460e-b45f-ad60a6082566 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:15.880500 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-c3ffc392-d690-460e-b45f-ad60a6082566 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025862 Sep 15 04:16:15.881076 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 14/29] 10.222.0.37 () {64 vars in 1333 bytes} [Wed Sep 15 04:16:15 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:16:18.193797 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-2a609b17-2e46-4a97-917a-52b4fe5e83e5 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:18.194783 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-2a609b17-2e46-4a97-917a-52b4fe5e83e5 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 15 04:16:18.195503 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 16/30] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:16:18.255250 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-5dffd888-433d-4c57-98b6-fabd03418ba4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:18.273606 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-5dffd888-433d-4c57-98b6-fabd03418ba4 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072117 Sep 15 04:16:18.282998 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 15/31] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:18.287011 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-f6226c8d-6e83-438c-b8da-5d5264411937 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:18.317435 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-f6226c8d-6e83-438c-b8da-5d5264411937 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033907 Sep 15 04:16:18.318030 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 17/32] 10.222.0.37 () {64 vars in 1333 bytes} [Wed Sep 15 04:16:18 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:16:20.567331 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-5dffd888-433d-4c57-98b6-fabd03418ba4 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:16:20.569076 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-5dffd888-433d-4c57-98b6-fabd03418ba4 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002245 Sep 15 04:16:20.569541 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 16/33] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:16:20 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:16:20.631109 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "id": "5", "rxtx_factor": 1.0}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:20.650432 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.074141 Sep 15 04:16:20.651209 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 18/34] 10.222.0.37 () {64 vars in 1283 bytes} [Wed Sep 15 04:16:20 2021] POST /compute/v2.1/flavors => generated 408 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:16:20.663635 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-57ae7383-4f62-4aca-8a6d-c46598996c55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:16:20.693651 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-57ae7383-4f62-4aca-8a6d-c46598996c55 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033284 Sep 15 04:16:20.699708 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 17/35] 10.222.0.37 () {64 vars in 1333 bytes} [Wed Sep 15 04:16:20 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:17:00.350851 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:00.351868 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 15 04:17:00.352255 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 19/36] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:17:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:00.409768 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-f150b959-f16c-4b27-aae7-79c11e9e8ec5 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:00.427631 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-f150b959-f16c-4b27-aae7-79c11e9e8ec5 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068052 Sep 15 04:17:00.428182 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 18/37] 10.222.0.37 () {60 vars in 1292 bytes} [Wed Sep 15 04:17:00 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:17:01.858914 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:01.859928 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-66ae6236-45b6-48a7-8fc5-d477ac51e076 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 15 04:17:01.860321 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 20/38] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:01 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:02.049406 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-474cf5e5-544b-42ee-9e27-cf126b85b888 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:02.054740 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.wsgi [None req-474cf5e5-544b-42ee-9e27-cf126b85b888 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 04:17:02.055340 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-474cf5e5-544b-42ee-9e27-cf126b85b888 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:02.056131 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-474cf5e5-544b-42ee-9e27-cf126b85b888 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057433 Sep 15 04:17:02.056640 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 19/39] 10.222.0.37 () {60 vars in 1191 bytes} [Wed Sep 15 04:17:01 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 04:17:02.066944 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-9e02457a-9b70-4d04-ba89-ddf5ce7b40dd admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:02.088043 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-9e02457a-9b70-4d04-ba89-ddf5ce7b40dd admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024548 Sep 15 04:17:02.088517 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 21/40] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:17:02.099466 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-cbca584c-3ddf-4f69-8721-9dc297e7ab0a admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:02.120012 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-cbca584c-3ddf-4f69-8721-9dc297e7ab0a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024619 Sep 15 04:17:02.120532 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 20/41] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:02 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:17:02.130290 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-3dfa18e4-5286-4c45-99b7-47acc24aa6e8 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:02.135595 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.wsgi [None req-3dfa18e4-5286-4c45-99b7-47acc24aa6e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 15 04:17:02.136163 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-3dfa18e4-5286-4c45-99b7-47acc24aa6e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:02.136952 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-3dfa18e4-5286-4c45-99b7-47acc24aa6e8 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010181 Sep 15 04:17:02.138029 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 22/42] 10.222.0.37 () {60 vars in 1191 bytes} [Wed Sep 15 04:17:02 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 04:17:03.504621 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-cbca584c-3ddf-4f69-8721-9dc297e7ab0a admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:03.505646 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-cbca584c-3ddf-4f69-8721-9dc297e7ab0a admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Sep 15 04:17:03.506034 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 21/43] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:03.695271 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-98e6d081-44d0-46a6-972d-b8be98c62c84 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:03.700865 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.wsgi [None req-98e6d081-44d0-46a6-972d-b8be98c62c84 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 04:17:03.701418 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-98e6d081-44d0-46a6-972d-b8be98c62c84 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:03.702199 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-98e6d081-44d0-46a6-972d-b8be98c62c84 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.058808 Sep 15 04:17:03.702691 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 23/44] 10.222.0.37 () {60 vars in 1191 bytes} [Wed Sep 15 04:17:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 04:17:03.712308 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-3c5fd689-ba07-42f6-a850-fa4cfb8bf2d9 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:03.725339 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-3c5fd689-ba07-42f6-a850-fa4cfb8bf2d9 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016559 Sep 15 04:17:03.725853 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 22/45] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:17:03.735919 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-08a60cf6-c885-454e-a726-16e2486fb9e6 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:03.749538 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-08a60cf6-c885-454e-a726-16e2486fb9e6 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017119 Sep 15 04:17:03.750053 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 24/46] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:03 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:17:03.759543 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-5cfe627c-4f18-427d-bb7a-3bc8be5ea06a admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:03.764602 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.wsgi [None req-5cfe627c-4f18-427d-bb7a-3bc8be5ea06a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 15 04:17:03.765188 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-5cfe627c-4f18-427d-bb7a-3bc8be5ea06a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:03.765954 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-5cfe627c-4f18-427d-bb7a-3bc8be5ea06a admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009889 Sep 15 04:17:03.766427 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 23/47] 10.222.0.37 () {60 vars in 1191 bytes} [Wed Sep 15 04:17:03 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 04:17:05.127273 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-08a60cf6-c885-454e-a726-16e2486fb9e6 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:05.128276 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-08a60cf6-c885-454e-a726-16e2486fb9e6 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 15 04:17:05.128669 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 25/48] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:05 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:05.323656 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-7bed07dd-c5d1-4e48-9086-97b1d087526d admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:05.329661 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.wsgi [None req-7bed07dd-c5d1-4e48-9086-97b1d087526d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 04:17:05.330235 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-7bed07dd-c5d1-4e48-9086-97b1d087526d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93197) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:05.331027 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-7bed07dd-c5d1-4e48-9086-97b1d087526d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057778 Sep 15 04:17:05.331568 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 24/49] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:17:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 15 04:17:05.341940 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-ff7eb937-6e4e-41f8-906f-aac3bf80df09 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:05.355220 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-ff7eb937-6e4e-41f8-906f-aac3bf80df09 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017485 Sep 15 04:17:05.355805 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 26/50] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:17:05.366317 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:05.379644 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016859 Sep 15 04:17:05.380199 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 25/51] 10.222.0.37 () {60 vars in 1211 bytes} [Wed Sep 15 04:17:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:17:05.390470 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-a3f5a2cd-d262-46ae-93fb-54b4f64e3f6d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:05.395590 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.wsgi [None req-a3f5a2cd-d262-46ae-93fb-54b4f64e3f6d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 15 04:17:05.396149 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-a3f5a2cd-d262-46ae-93fb-54b4f64e3f6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93196) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:17:05.396924 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-a3f5a2cd-d262-46ae-93fb-54b4f64e3f6d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010671 Sep 15 04:17:05.397407 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 27/52] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:17:05 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 15 04:17:06.769468 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:06.770461 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Sep 15 04:17:06.770843 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 26/53] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:06.960315 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-231f5662-4601-40b7-aa96-9d8e41c8de2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:17:06.978407 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-231f5662-4601-40b7-aa96-9d8e41c8de2d admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069354 Sep 15 04:17:06.978873 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 28/54] 10.222.0.37 () {64 vars in 1236 bytes} [Wed Sep 15 04:17:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:17:08.328031 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:08.329058 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 15 04:17:08.329444 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 27/55] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:08 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:08.519675 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-397344d3-2a10-4ea9-922e-98475be11c35 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:17:08.537549 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-397344d3-2a10-4ea9-922e-98475be11c35 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068276 Sep 15 04:17:08.538030 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 29/56] 10.222.0.37 () {64 vars in 1236 bytes} [Wed Sep 15 04:17:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:17:09.886103 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:09.887661 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 15 04:17:09.888056 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 28/57] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:10.078450 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-c4b9223e-665b-40a1-a3a6-057017493648 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:17:10.097250 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-c4b9223e-665b-40a1-a3a6-057017493648 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070580 Sep 15 04:17:10.097712 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 30/58] 10.222.0.37 () {64 vars in 1236 bytes} [Wed Sep 15 04:17:10 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:17:11.431193 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:11.432192 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 15 04:17:11.432768 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 29/59] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:11.624113 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-b8c4ed3b-f594-437c-ade9-ca43226970a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:17:11.641452 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-b8c4ed3b-f594-437c-ade9-ca43226970a7 admin admin] 10.222.0.37 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071411 Sep 15 04:17:11.641911 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 31/60] 10.222.0.37 () {64 vars in 1236 bytes} [Wed Sep 15 04:17:11 2021] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:17:12.986253 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:12.987290 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 Sep 15 04:17:12.987686 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 30/61] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:17:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:13.182515 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-07d17e72-68cc-42c8-aaaf-7330e85cd2b9 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:13.202794 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-07d17e72-68cc-42c8-aaaf-7330e85cd2b9 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073732 Sep 15 04:17:13.203297 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 32/62] 10.222.0.37 () {60 vars in 1203 bytes} [Wed Sep 15 04:17:13 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:17:58.129129 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.130278 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-83ee4157-2b52-440f-b64f-e9fd327ac046 admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 15 04:17:58.130990 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 31/63] 10.222.0.37 () {54 vars in 931 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:17:58.194570 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-1677c6d0-657b-42f9-9389-0a3a37ed270e admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.214873 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-1677c6d0-657b-42f9-9389-0a3a37ed270e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077064 Sep 15 04:17:58.215438 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 33/64] 10.222.0.37 () {60 vars in 1292 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:17:58.238171 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-52fc22ba-c3fb-40d7-8e3e-b79170ef963e admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.245874 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-52fc22ba-c3fb-40d7-8e3e-b79170ef963e admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011324 Sep 15 04:17:58.246384 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 32/65] 10.222.0.37 () {60 vars in 1283 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:17:58.257753 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-80072b5f-c639-44f4-b2ef-d1f7164f7328 admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.265638 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-80072b5f-c639-44f4-b2ef-d1f7164f7328 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011331 Sep 15 04:17:58.266151 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 34/66] 10.222.0.37 () {60 vars in 1286 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:17:58.277796 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-4855bc3c-f92b-474d-915e-75a1e1512a75 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.285077 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-4855bc3c-f92b-474d-915e-75a1e1512a75 admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011230 Sep 15 04:17:58.285576 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 33/67] 10.222.0.37 () {60 vars in 1286 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:17:58.298017 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:17:58.305305 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] 10.222.0.37 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010645 Sep 15 04:17:58.305809 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 35/68] 10.222.0.37 () {60 vars in 1283 bytes} [Wed Sep 15 04:17:58 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:19:16.801192 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-0f5746cf-34f1-4ad7-901d-489f5bc73396 tempest-verify_tempest_config-1684162560 tempest-verify_tempest_config-1684162560-project] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:19:16.803250 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-0f5746cf-34f1-4ad7-901d-489f5bc73396 tempest-verify_tempest_config-1684162560 tempest-verify_tempest_config-1684162560-project] 10.222.0.37 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.105235 Sep 15 04:19:16.803776 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 34/69] 10.222.0.37 () {58 vars in 1134 bytes} [Wed Sep 15 04:19:16 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:20:40.650207 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:40.651348 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 15 04:20:40.651738 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 36/70] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:20:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:20:40.906991 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:40.908173 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:20:40.908173 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:20:40.909670 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:40.910101 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:40.910881 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:40.911326 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:40.944348 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-b53809d6-2c9a-42a9-90af-768c6f4d4b8d admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.148567 Sep 15 04:20:40.944897 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 35/71] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:20:40 2021] GET /compute/v2.1/os-services => generated 794 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:20:42.321535 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:42.322536 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 15 04:20:42.322928 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 37/72] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:20:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:20:42.516143 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:42.517311 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:20:42.517311 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:20:42.518833 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:42.519308 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:42.520095 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:42.520525 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:42.541088 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-6a2ca46d-3a0b-4524-bf07-123caecd9350 admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077972 Sep 15 04:20:42.541583 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 36/73] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:20:42 2021] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:20:54.305065 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:54.306066 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 15 04:20:54.306461 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 38/74] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:20:54 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:20:54.501390 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:54.502518 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:20:54.502518 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:20:54.504030 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:54.504463 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:54.505233 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:54.506062 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:54.529259 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-f87f329b-593c-496e-a1c7-dbfeb4460cbe admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080657 Sep 15 04:20:54.529730 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 37/75] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:20:54 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:20:55.900608 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: DEBUG nova.api.openstack.wsgi [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] Calling method '>' {{(pid=93196) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:55.901611 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: INFO nova.api.openstack.requestlog [None req-977848d6-c3ab-41f7-bf23-c307d01b8f5d admin admin] 10.222.0.37 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 15 04:20:55.902008 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: [pid: 93196|app: 0|req: 39/76] 10.222.0.37 () {56 vars in 1075 bytes} [Wed Sep 15 04:20:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:20:56.100175 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG nova.api.openstack.wsgi [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] Calling method '>' {{(pid=93197) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:20:56.101494 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:20:56.101494 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: warnings.warn(msg) Sep 15 04:20:56.103109 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:56.103573 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:56.104357 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:20:56.104781 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: DEBUG oslo_concurrency.lockutils [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93197) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:20:56.125495 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: INFO nova.api.openstack.requestlog [None req-85ee362f-351f-47df-b808-b96f2ca49ffc admin admin] 10.222.0.37 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.078847 Sep 15 04:20:56.125975 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: [pid: 93197|app: 0|req: 38/77] 10.222.0.37 () {60 vars in 1194 bytes} [Wed Sep 15 04:20:56 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:21:52.508718 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: Wed Sep 15 04:21:52 2021 - graceful shutdown triggered... Sep 15 04:21:52.508848 dv-cinder-760153-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 15 04:21:52.509755 dv-cinder-760153-12-iscsi devstack@n-api.service[93196]: Gracefully killing worker 1 (pid: 93196)... Sep 15 04:21:52.510842 dv-cinder-760153-12-iscsi devstack@n-api.service[93197]: Gracefully killing worker 2 (pid: 93197)... Sep 15 04:21:53.509928 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: worker 1 buried after 1 seconds Sep 15 04:21:53.509928 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: worker 2 buried after 1 seconds Sep 15 04:21:53.509928 dv-cinder-760153-12-iscsi devstack@n-api.service[93195]: goodbye to uWSGI. Sep 15 04:21:53.511473 dv-cinder-760153-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 15 04:21:53.512025 dv-cinder-760153-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 15 04:21:53.514817 dv-cinder-760153-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 15 04:21:53.524233 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 15 04:21:53 2021] *** Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: nodename: dv-cinder-760153-12-iscsi Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: machine: x86_64 Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: clock source: unix Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: pcre jit disabled Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: detected number of CPU cores: 4 Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: current working directory: / Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: detected binary path: /usr/bin/uwsgi-core Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: your processes number limit is 47680 Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: your memory page size is 4096 bytes Sep 15 04:21:53.526220 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: detected max file descriptor number: 2048 Sep 15 04:21:53.527062 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: lock engine: pthread robust mutexes Sep 15 04:21:53.527062 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: thunder lock: enabled Sep 15 04:21:53.527062 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 15 04:21:53.527062 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 15 04:21:53.572073 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: Python main interpreter initialized at 0x556a994ca9c0 Sep 15 04:21:53.572073 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: python threads support enabled Sep 15 04:21:53.572073 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: your server socket listen backlog is limited to 100 connections Sep 15 04:21:53.572073 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: your mercy for graceful operations on workers is 90 seconds Sep 15 04:21:53.572464 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 04:21:53.572536 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: *** Operational MODE: preforking *** Sep 15 04:21:53.572789 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: *** uWSGI is running in multiple interpreter mode *** Sep 15 04:21:53.572789 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: spawned uWSGI master process (pid: 108166) Sep 15 04:21:53.572993 dv-cinder-760153-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 15 04:21:53.574238 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: spawned uWSGI worker 1 (pid: 108181, cores: 1) Sep 15 04:21:53.574238 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: spawned uWSGI worker 2 (pid: 108182, cores: 1) Sep 15 04:21:53.574238 dv-cinder-760153-12-iscsi devstack@n-api.service[108166]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 04:21:55.411181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:21:55.411181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: from cryptography.utils import int_from_bytes Sep 15 04:21:55.417671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:21:55.417671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: from cryptography.utils import int_from_bytes Sep 15 04:21:55.476143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:21:55.476143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: from cryptography.utils import int_from_bytes Sep 15 04:21:55.476821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 04:21:55.476821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: from cryptography.utils import int_from_bytes Sep 15 04:21:58.126943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 04:21:58.127593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 04:21:58.127736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 04:21:58.128113 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 04:21:58.128381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 04:21:58.128781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.129122 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.129456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.129788 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.130134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.130460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.130794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.131141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.132030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.132299 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.132624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.132961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760153-12-iscsi {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.133295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.133616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.133940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.134270 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.134586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.134922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.135269 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.135788 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.136266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.136579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.137070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.137265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.137592 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.137913 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.138250 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.138584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.138922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.139261 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.139690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760153-12-iscsi {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.140019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.140342 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.140668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.141104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.141426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.141751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.142084 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.142419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.142741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.143086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.143448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.143780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.144115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.144431 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.144752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.145075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.145410 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.145731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.146047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.146312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.146635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.146970 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.147983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.148327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.148766 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.149020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.149357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.149695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.150023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.150345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.150664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.150984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.151341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.151661 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.151986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.152304 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.152638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.152971 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.153488 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.153812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.154148 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.154573 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.154839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.155193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.155542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.155874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.156196 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.156529 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.156860 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.157179 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.157501 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.157818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.158149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.158486 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.158801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.159061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.159401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.159732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.160054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.160373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.160690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.161006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.161319 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.161634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.161961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.162279 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.162596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.163229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.163565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.163890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.164210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.164531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.164871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.165205 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.165523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.165843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.166158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.166479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.166816 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.167156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.167476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.167811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.168147 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.168447 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.168778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.169096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.169415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.169746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.170060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.170379 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.170707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.171025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.171379 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.171698 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.172022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.172338 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.172654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.172969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.173283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.173597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.173930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.174263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.174588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.174907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.175248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.175583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.175940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.176283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.176642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.176970 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.177317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.177660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.177989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.178341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.178676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.179014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.179366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.179688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.180012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.180345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.180676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.181020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.181348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.181676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.182012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.182336 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.182667 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.183008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.183369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.183694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.184049 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.184400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.184726 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.185064 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.185389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.185723 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.186051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.186374 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.186698 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.187306 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.187632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.187957 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.188303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.188634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.188963 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.189279 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.189596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.189914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.190236 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.190560 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.190890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.191253 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.191575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.191928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.192328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.192658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.192983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.193301 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.193627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.193864 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 04:21:58.194951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 04:21:58.195033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.195176 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.195298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 04:21:58.195455 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.195674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 04:21:58.195937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 04:21:58.196325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.196657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.196983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.197162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.197305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.197511 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.197638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.197863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.197955 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.198198 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.198292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.198531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.198625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.198870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.199000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.199150 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.199287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.199483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.199812 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-760153-12-iscsi {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.200138 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.200450 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.200762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.201082 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.201313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.201541 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.201669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.201774 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.201999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.202092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.202364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.202509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.202703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.202824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.203050 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.203175 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.203439 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.203542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.203773 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.203869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.204092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.204191 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.204407 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.204500 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.204731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.204824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.205043 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.205135 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.205366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.205465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.205678 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.205781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.206026 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.206130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-760153-12-iscsi {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.206351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.206458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.206686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.206785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.207005 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.207097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.207386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.207489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.207710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.207812 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.208034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.208137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.208356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.208458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.208679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.208770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.208994 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.209342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.210440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.210541 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.210875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.210978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.211229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.211459 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.211590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.211917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.212035 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.212247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.212602 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.212712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.212948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.213050 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.213286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.213605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.213926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.214186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.214505 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.214844 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.214971 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.215203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.215366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.215539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.215717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.215820 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.216230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.216323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.216482 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.216584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.216680 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.216815 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.216965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.217136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.217276 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.217478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.217592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.217826 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.217941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.218164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.218259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.218502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.218609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.218815 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.218908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.219161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.219259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.219475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.219591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.219796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.219902 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.220221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.220324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.220579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.220684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.220899 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.221013 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.221272 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.221383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.37 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.221555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.37 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.221670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.221869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.221974 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.222217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.222327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.222542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.222858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.223207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.223537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.223854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.224190 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.224375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.224545 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.224679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.224888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.224996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.225369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.225532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.225714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.226001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.226104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.226280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.226376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.226715 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.226818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.227108 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.227485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.227841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.228177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.228531 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.228878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.229193 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.229295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.229623 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.229729 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.229973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.230066 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.230327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.230419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.230642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.230743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.231008 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.231122 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.231370 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.231500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.231731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.231825 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.232069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.232171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.232411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.232564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.232758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.232858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.233093 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.233198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.233400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.233507 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.233718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.233813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.234033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.234127 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.234366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.234556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.234697 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.234871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.235047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.235191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.235373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.235702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.235803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.236027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.236131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.236361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.236467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.236681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.236774 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.236995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.237098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.237309 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.237404 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.237634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.237727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.237937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.238030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.238249 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.238349 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.238571 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.238666 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.238884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.238979 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.239222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.239336 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.239533 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.239653 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.239847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.239960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.240153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.240259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.240463 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.240573 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.240774 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.241435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.241656 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.241765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.242033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.242138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.242387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.242489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.242711 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.242805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.243028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.243153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.243405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.243559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.243696 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.243793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.244024 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 04:21:58.244127 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.244347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.244441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.244676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.244771 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245017 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245112 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245334 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.245981 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246306 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246725 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.246942 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247048 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247619 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.247939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248040 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248258 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248676 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.248989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.249221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.249315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.249538 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.249823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.249982 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.250903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251185 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251481 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.251942 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252146 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.252934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253124 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.253853 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254161 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.254829 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255017 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.255994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.256097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.256317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.256420 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.257210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.257484 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.257627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.257885 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258846 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.258941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259525 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.259985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260652 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260781 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.260874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261278 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261735 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.261828 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262055 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262159 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262689 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.262783 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263018 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263122 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263363 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263678 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.263999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.264943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265262 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.265997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266854 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.266956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267655 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267846 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.267948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268161 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268486 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268806 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.268900 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269118 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.269851 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270056 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270472 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.270994 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271088 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271332 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271429 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.271953 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272342 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272673 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.272999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273185 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273505 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.273976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.274162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.274304 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.274555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.274648 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.274914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275295 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275396 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275620 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.275941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276035 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276262 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276582 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276683 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.276996 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277322 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277689 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.277947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278486 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278587 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.278908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279474 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279570 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.279901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.280112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.280206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.280436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.280538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.280751 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281154 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281448 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.281841 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282702 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.282796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283116 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.283780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284099 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284636 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.284950 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285692 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.285920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286562 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286656 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.286966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.287219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.287334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.287541 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.287647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.287907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288546 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.288978 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289823 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.289922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290759 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.290895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291200 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.291822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292035 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292137 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292355 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.292979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293289 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.293921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294237 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294565 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294698 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.294892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295026 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295241 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295371 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.295869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296496 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.296789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297528 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.297887 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298725 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.298830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299365 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299473 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.299779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300002 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300103 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300319 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300421 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300635 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.300951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301266 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.301901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302673 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.302860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.303102 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.303267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.304462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.304624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.304774 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.304957 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.305328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.305440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.305689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.305921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306264 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306708 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.306919 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307041 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307760 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.307945 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308766 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.308915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309089 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309233 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309432 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309549 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.309868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310208 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.310881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.311069 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.311234 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.311415 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.311562 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.311981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312507 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.312927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.313921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314766 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.314868 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315412 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.315832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.316810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317124 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317457 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.317984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.318131 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.318315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.318416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.318627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.318729 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.319047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.319731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.319890 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.319997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320208 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320529 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.320948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.321208 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.321303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.321526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.321610 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.321841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322791 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.322899 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323104 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323254 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.323871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.324814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325024 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325337 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.325971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326073 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326388 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.326917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327666 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327887 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.327980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328199 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328293 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.328945 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329268 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.329888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330511 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.330878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331444 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.331923 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332306 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332619 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332716 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.332935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333649 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333866 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.333973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.334177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.334323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.334489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.334611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.334935 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.335942 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.336153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.336468 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.336568 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.336808 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.336952 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.337882 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338421 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.338850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339056 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339515 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.339811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340039 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340133 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340459 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340675 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.340987 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341624 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.341942 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342258 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.342914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343268 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343580 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343683 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.343896 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344622 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.344966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.345893 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346112 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346744 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.346852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347170 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347398 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347716 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.347811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348133 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.348985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.349212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.349354 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.349796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.349932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.350943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351301 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.351969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352608 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352739 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.352930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.353991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354549 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354656 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354864 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.354966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.355205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.355437 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.355542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.355803 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.355898 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.356859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.357821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358053 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358146 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.358798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359192 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359480 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.359789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360128 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360442 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360665 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.360991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361716 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.361947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362354 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362580 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.362907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363029 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363562 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363655 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.363886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364307 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.364971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.365188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.365283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.365509 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.365611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.366358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.366470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.366682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.366909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.367966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368189 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368667 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.368934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369141 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369460 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369776 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.369869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370403 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370713 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.370813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371518 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371776 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.371999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372329 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372462 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.372976 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373309 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373423 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373720 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.373938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374563 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374666 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.374985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375344 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375557 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375700 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.375984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.376939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377613 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377831 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.377927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378248 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378775 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.378878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379093 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379428 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.379833 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380365 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380467 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.380986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.381082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.381297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382271 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382529 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.382966 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.383957 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.384916 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.385927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386799 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.386894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387461 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387570 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.387873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388745 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.388887 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389381 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389554 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.389806 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390455 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.390999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.391233 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.391376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.391560 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.391703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.391882 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392200 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392678 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.392845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393481 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.393993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394314 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394447 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.394985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395342 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395450 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.395997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396773 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.396992 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.397122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.397353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.397669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.397761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.397989 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398312 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.398951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.399934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400393 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400570 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.400889 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.401079 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.401208 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.401419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.401539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.401681 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108182) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 04:21:58.401880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.402206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.402527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.402860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.403444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.403720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.404049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.404396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.404734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.405070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.405399 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.405731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.406069 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.406386 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.408988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.409177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411654 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.411987 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.412299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.412612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.412995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.413314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.413801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.414119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.414439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.414756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.415069 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.415415 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.415732 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.416065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.416380 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.416694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.417005 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.417325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.417639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.417954 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.418267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.418581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.418899 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.419236 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.419556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.420016 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.420452 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.420789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.420917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.421195 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.421528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.421843 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.422158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.422489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.422809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.423157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.423490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.423808 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.424167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.424492 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.424644 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_db.sqlalchemy.engines [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.425061 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.425401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.425756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.426106 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.426456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.426772 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.427088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.427425 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.427757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.428075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.428925 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.429417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.429743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.430063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.430385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.430705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.431022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.431372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.431723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.432053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.432417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.432719 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.433032 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.433296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.433616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.433933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.434252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.434576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.434912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.435260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.435575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.436093 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.436420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.437006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.437342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.437661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.437991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.438321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.438639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.438968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.439316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.439655 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.440003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.440342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.440675 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.440992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.441304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.441617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.441934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.442274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.442594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.442925 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.443266 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.443598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.444637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.444796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.445303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.445631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.445955 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.446302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.446621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.446939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.447285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.447604 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.447924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.448242 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.448576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.448907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.449221 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.449554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.449879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.450207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.450529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.450847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.451208 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.451525 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.451845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.452161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.452476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.452797 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.453116 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.453448 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.453778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.454111 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.454443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.454794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.455112 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.455486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.455817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 04:21:58.456065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 04:21:58.478068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_db.sqlalchemy.engines [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.506068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.context [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9(cell1) {{(pid=108182) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 04:21:58.511538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:21:58.513115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:21:58.513938 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:21:58.515930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:21:58.526506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_db.sqlalchemy.engines [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.528071 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_db.sqlalchemy.engines [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.560938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.context [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9(cell1) {{(pid=108181) load_cells /opt/stack/nova/nova/context.py:464}} Sep 15 04:21:58.565613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:21:58.567220 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:21:58.568144 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:21:58.571335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:21:58.582830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_db.sqlalchemy.engines [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.583788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_db.sqlalchemy.engines [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.799651 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_db.sqlalchemy.engines [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108182) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:58.848288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_db.sqlalchemy.engines [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 04:21:59.140232 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: WARNING keystonemiddleware.auth_token [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:21:59.147051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: WARNING keystonemiddleware.auth_token [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:21:59.195091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: WARNING keystonemiddleware.auth_token [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:21:59.202013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: WARNING keystonemiddleware.auth_token [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:21:59.495050 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: WARNING keystonemiddleware.auth_token [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:21:59.500384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: WARNING keystonemiddleware.auth_token [None req-681e0432-f341-44b2-9cf9-1c9b5d24f1e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:21:59.505586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a994ca9c0 pid: 108182 (default app) Sep 15 04:21:59.546741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: WARNING keystonemiddleware.auth_token [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 15 04:21:59.551975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: WARNING keystonemiddleware.auth_token [None req-e07a1fd0-19be-4eb6-946d-83723cafdd1e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 15 04:21:59.558101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a994ca9c0 pid: 108181 (default app) Sep 15 04:22:30.445394 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ca84cdbe-9a6b-4393-91dd-633e8a9b6cfc tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Action: 'create', calling method: .version_select at 0x7f02a493a9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1911707032", "metadata": {"Type": "work"}}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:32.106736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ca84cdbe-9a6b-4393-91dd-633e8a9b6cfc tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.259207 Sep 15 04:22:32.107695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 1/1] 10.222.0.37 () {60 vars in 1156 bytes} [Wed Sep 15 04:22:29 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2262 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 15 04:22:32.122303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d45f48c1-725a-4a1b-95ac-9a4ed41a519d tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a4802550>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:32.233903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d45f48c1-725a-4a1b-95ac-9a4ed41a519d tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 200 len: 353 microversion: 2.1 time: 0.118431 Sep 15 04:22:32.234476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 2/2] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:32 2021] GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:33.246271 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-df72f45e-cf24-48cb-b603-61b9977293ae tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a4802dc0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:33.287256 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-70dcee43-cbae-46f7-98b8-83735ca15448 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Action: 'create', calling method: .version_select at 0x7f02a493b9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-7031209"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:33.360193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-df72f45e-cf24-48cb-b603-61b9977293ae tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 200 len: 354 microversion: 2.1 time: 0.115792 Sep 15 04:22:33.361023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 3/3] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:33 2021] GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:33.374638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-39f1a82e-5563-422e-9559-f6aaea0a53e7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a4802e50>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:33.436002 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-39f1a82e-5563-422e-9559-f6aaea0a53e7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 200 len: 354 microversion: 2.1 time: 0.065073 Sep 15 04:22:33.444572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 4/4] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:33 2021] GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 354 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:33.449552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-770f9763-d851-445d-b55d-6fe58333fec2 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a481b790>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:33.659587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-770f9763-d851-445d-b55d-6fe58333fec2 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 202 len: 0 microversion: 2.1 time: 0.213407 Sep 15 04:22:33.660641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 5/5] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:22:33 2021] DELETE /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:22:33.669265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0bc01ffd-6ade-4598-9aae-e997062d43f2 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a4802ee0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:33.757911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0bc01ffd-6ade-4598-9aae-e997062d43f2 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 200 len: 353 microversion: 2.1 time: 0.092073 Sep 15 04:22:33.758609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 6/6] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:33 2021] GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:34.769635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e2f4f8e6-aefe-4fd1-ab54-98c07e7159c7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Calling method '.version_select at 0x7f02a48ad820>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:34.822024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-e2f4f8e6-aefe-4fd1-ab54-98c07e7159c7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] HTTP exception thrown: Volume 111cd084-9ca2-4342-84f1-7feb3f6882a4 could not be found. Sep 15 04:22:34.823608 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e2f4f8e6-aefe-4fd1-ab54-98c07e7159c7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] Returning 404 to user: Volume 111cd084-9ca2-4342-84f1-7feb3f6882a4 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:22:34.825216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e2f4f8e6-aefe-4fd1-ab54-98c07e7159c7 tempest-VolumesGetTestJSON-2012101779 tempest-VolumesGetTestJSON-2012101779-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4" status: 404 len: 109 microversion: 2.1 time: 0.058757 Sep 15 04:22:34.827190 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 7/7] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:34 2021] GET /compute/v2.1/os-volumes/111cd084-9ca2-4342-84f1-7feb3f6882a4 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:22:35.981846 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-70dcee43-cbae-46f7-98b8-83735ca15448 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 4.019735 Sep 15 04:22:35.988703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 1/8] 10.222.0.37 () {60 vars in 1155 bytes} [Wed Sep 15 04:22:31 2021] POST /compute/v2.1/os-volumes => generated 342 bytes in 4022 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 15 04:22:35.996421 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ef8b992c-3a70-42d3-a340-e7cf8d3e7516 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4802e50>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:36.110534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ef8b992c-3a70-42d3-a340-e7cf8d3e7516 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 200 len: 342 microversion: 2.1 time: 0.118366 Sep 15 04:22:36.111105 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 8/9] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:35 2021] GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 342 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:36.744558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1418364580", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "c5a8cea0-d3b0-422c-bcad-9f50090084d7"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:36.972869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] validate_networks() for [('c5a8cea0-d3b0-422c-bcad-9f50090084d7', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:22:37.126559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-03732cd5-1a00-4e64-bb60-e615ba1ae344 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4802ee0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:37.253428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-03732cd5-1a00-4e64-bb60-e615ba1ae344 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 200 len: 343 microversion: 2.1 time: 0.134080 Sep 15 04:22:37.255446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 9/10] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:37 2021] GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 343 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:37.270321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-db818621-ffca-467b-a171-aff7b29e93d8 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Action: 'create', calling method: .version_select at 0x7f02a481bdc0>, body: {"snapshot": {"volume_id": "7311b83f-9d43-47e5-8266-b01c328e0ed6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-572894540"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:37.671607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-db818621-ffca-467b-a171-aff7b29e93d8 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.406581 Sep 15 04:22:37.672484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 10/11] 10.222.0.37 () {60 vars in 1162 bytes} [Wed Sep 15 04:22:37 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:37.682227 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f6c2c08a-ee9e-49a5-800a-5b41d302846f tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a481bee0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:37.803247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f6c2c08a-ee9e-49a5-800a-5b41d302846f tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.124493 Sep 15 04:22:37.804304 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 11/12] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:37 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:37.816355 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-77501a09-e48e-49e9-8a9a-766e41207203 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a481b9d0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:37.891352 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-77501a09-e48e-49e9-8a9a-766e41207203 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.081517 Sep 15 04:22:37.892417 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 12/13] 10.222.0.37 () {58 vars in 1140 bytes} [Wed Sep 15 04:22:37 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:37.902074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-34ae1969-10d5-4dde-a339-82e4526af14c tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a482e040>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:37.954026 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-34ae1969-10d5-4dde-a339-82e4526af14c tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.055500 Sep 15 04:22:37.955083 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 13/14] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:37 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:38.540832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:22:38.541340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:22:38.542491 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:22:38.543009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:22:38.546360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:22:38.593294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.594210 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.601949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:38.602647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:38.654387 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Getting quotas for project f244fd964a1e408eb0815b292899cdeb. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:38.666000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Getting quotas for user c533ed3963af4efdb08c5175e17d85d7 and project f244fd964a1e408eb0815b292899cdeb. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:38.686239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:22:38.691504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:22:38.841043 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c7e577d1-c8ef-447b-bac6-6f19ca3a2645 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.344595 Sep 15 04:22:38.844532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 2/15] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:22:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:22:38.853075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ae44107e-8d31-4bdb-84d2-814bbcdd3b2d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:38.853914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ae44107e-8d31-4bdb-84d2-814bbcdd3b2d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:38.967161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2e3e61e1-a296-422f-8783-9983676fc4e2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4716ca0>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:39.061744 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2e3e61e1-a296-422f-8783-9983676fc4e2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.097636 Sep 15 04:22:39.061744 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 3/16] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:38 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:39.099478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ae44107e-8d31-4bdb-84d2-814bbcdd3b2d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:39.124946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ae44107e-8d31-4bdb-84d2-814bbcdd3b2d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1215 microversion: 2.1 time: 0.273204 Sep 15 04:22:39.125741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 14/17] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:38 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1215 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:22:40.073824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-80a920bd-2d8a-411d-a1bb-c988feba20ff tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a47258b0>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:40.129212 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-80a920bd-2d8a-411d-a1bb-c988feba20ff tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.059222 Sep 15 04:22:40.129783 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 4/18] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:40 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:40.141697 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1008c451-ff27-45f3-b2e1-e6e893f54400 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:40.143149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1008c451-ff27-45f3-b2e1-e6e893f54400 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:40.249742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1008c451-ff27-45f3-b2e1-e6e893f54400 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:40.261942 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1008c451-ff27-45f3-b2e1-e6e893f54400 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1215 microversion: 2.1 time: 0.123940 Sep 15 04:22:40.264293 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 15/19] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:40 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:41.142100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a328e9d6-5521-4395-b529-b4f4804093e7 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4725f70>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:41.221709 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a328e9d6-5521-4395-b529-b4f4804093e7 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.083632 Sep 15 04:22:41.222279 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 5/20] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:41 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:41.281384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:41.285554 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:41.304970 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:41.305311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:41.306183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:41.306564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:41.649066 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:41.678190 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f3f238b9-3351-45cc-b1cb-43b50e96e01c tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a4725550>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:41.692984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07f10376-2ec0-4fd0-92eb-c3cc9b9429d2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1219 microversion: 2.1 time: 0.415477 Sep 15 04:22:41.695885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 16/21] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:41 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1219 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:22:41.760446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f3f238b9-3351-45cc-b1cb-43b50e96e01c tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/850ee6ac-e28b-4d85-854d-5ff81c88f7af" status: 200 len: 351 microversion: 2.1 time: 0.090318 Sep 15 04:22:41.768952 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 6/22] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:41 2021] GET /compute/v2.1/os-volumes/850ee6ac-e28b-4d85-854d-5ff81c88f7af => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:42.234990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e14bf295-0cea-408f-ac85-f30e30d4fe58 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4763670>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:42.328125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e14bf295-0cea-408f-ac85-f30e30d4fe58 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 287 microversion: 2.1 time: 0.098165 Sep 15 04:22:42.328922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 17/23] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:42 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:42.339586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-27d9572c-8ee6-4c57-bb0e-145a2f48018a tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a36b7040>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:42.474096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-27d9572c-8ee6-4c57-bb0e-145a2f48018a tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "DELETE /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 202 len: 0 microversion: 2.1 time: 0.137606 Sep 15 04:22:42.474909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 7/24] 10.222.0.37 () {58 vars in 1254 bytes} [Wed Sep 15 04:22:42 2021] DELETE /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:22:42.483109 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-370307fa-f3d5-45ea-9d19-347cad2b2ab7 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4772790>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:42.550875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-370307fa-f3d5-45ea-9d19-347cad2b2ab7 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 200 len: 286 microversion: 2.1 time: 0.071417 Sep 15 04:22:42.551614 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 18/25] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:42 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:42.712245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:42.712947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:42.759202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:42.761011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:42.762058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:42.768742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:43.415882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-69fb9f3c-78af-4e3c-bf52-d8471a2e8d81 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a47721f0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:43.503577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:43.547855 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-69fb9f3c-78af-4e3c-bf52-d8471a2e8d81 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/44857469-ee4c-4dce-9422-b4848cfacaa4" status: 200 len: 351 microversion: 2.1 time: 0.135473 Sep 15 04:22:43.548431 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 19/26] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:43 2021] GET /compute/v2.1/os-volumes/44857469-ee4c-4dce-9422-b4848cfacaa4 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:43.563489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-761b8c7d-1ef5-4236-8a43-5e5b74671b8b tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a4763d30>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:43.571295 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-729a8abf-9b2b-4e6e-a5ef-17d4bfa9b3b1 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1285 microversion: 2.1 time: 0.862966 Sep 15 04:22:43.571894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 8/27] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:42 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1285 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:43.622257 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-761b8c7d-1ef5-4236-8a43-5e5b74671b8b tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] HTTP exception thrown: Snapshot 5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa could not be found. Sep 15 04:22:43.622836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-761b8c7d-1ef5-4236-8a43-5e5b74671b8b tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Returning 404 to user: Snapshot 5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:22:43.623752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-761b8c7d-1ef5-4236-8a43-5e5b74671b8b tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa" status: 404 len: 111 microversion: 2.1 time: 0.064095 Sep 15 04:22:43.630652 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 20/28] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:22:43 2021] GET /compute/v2.1/os-snapshots/5177f6d2-2a03-4f40-8de3-12c3d3e0b3aa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:22:43.634959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-23beba9b-6eba-487b-8595-9835a69c8bb3 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a366f670>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:43.749343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-23beba9b-6eba-487b-8595-9835a69c8bb3 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 202 len: 0 microversion: 2.1 time: 0.119271 Sep 15 04:22:43.750554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 9/29] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:22:43 2021] DELETE /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:22:43.760099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b57123e7-76de-4db4-97b3-3b2bfd99d36a tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a48ad820>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:43.869630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b57123e7-76de-4db4-97b3-3b2bfd99d36a tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 200 len: 342 microversion: 2.1 time: 0.114767 Sep 15 04:22:43.871579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 21/30] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:43 2021] GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 342 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:44.591976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:44.593489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:44.606645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:44.608889 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:44.609685 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:44.610119 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:44.790586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:44.804602 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b0949e9e-7fcb-4f68-8803-fd04ab992cbc tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1273 microversion: 2.1 time: 0.213407 Sep 15 04:22:44.815845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 22/31] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:44 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1273 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:44.882238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-788fd82a-8c81-4f09-bd15-37a231db619d tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a51def70>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:44.948905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-788fd82a-8c81-4f09-bd15-37a231db619d tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] HTTP exception thrown: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. Sep 15 04:22:44.949752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-788fd82a-8c81-4f09-bd15-37a231db619d tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Returning 404 to user: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:22:44.950853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-788fd82a-8c81-4f09-bd15-37a231db619d tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 404 len: 109 microversion: 2.1 time: 0.072831 Sep 15 04:22:44.951643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 23/32] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:44 2021] GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:22:44.970569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-90d4daf5-50a2-4334-a021-541212f65e92 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a51def70>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:45.049325 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-90d4daf5-50a2-4334-a021-541212f65e92 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] HTTP exception thrown: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. Sep 15 04:22:45.050320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-90d4daf5-50a2-4334-a021-541212f65e92 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Returning 404 to user: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:22:45.053635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-90d4daf5-50a2-4334-a021-541212f65e92 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 404 len: 109 microversion: 2.1 time: 0.086508 Sep 15 04:22:45.060594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 24/33] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:22:44 2021] DELETE /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:22:45.071617 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4d80afd6-7f9a-4065-bd02-ff8d6b3c2dd2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Calling method '.version_select at 0x7f02a47631f0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:45.119037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: .version_select at 0x7f02a4725820>, body: {"keypair": {"name": "tempest-keypair-204474707"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:45.158305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-4d80afd6-7f9a-4065-bd02-ff8d6b3c2dd2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] HTTP exception thrown: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. Sep 15 04:22:45.159255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4d80afd6-7f9a-4065-bd02-ff8d6b3c2dd2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] Returning 404 to user: Volume 7311b83f-9d43-47e5-8266-b01c328e0ed6 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:22:45.160807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4d80afd6-7f9a-4065-bd02-ff8d6b3c2dd2 tempest-VolumesSnapshotsTestJSON-1187662975 tempest-VolumesSnapshotsTestJSON-1187662975-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6" status: 404 len: 109 microversion: 2.1 time: 0.099028 Sep 15 04:22:45.162507 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 25/34] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:45 2021] GET /compute/v2.1/os-volumes/7311b83f-9d43-47e5-8266-b01c328e0ed6 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:22:45.222746 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:45.237010 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:45.368564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-70e46001-b711-463b-a0e4-b4fecad8c2f7 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a47e3820>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:45.547016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-70e46001-b711-463b-a0e4-b4fecad8c2f7 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/02966eb1-b6f7-4be4-b5de-76169bc0bc5d" status: 200 len: 351 microversion: 2.1 time: 0.182892 Sep 15 04:22:45.547955 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 26/35] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:22:45 2021] GET /compute/v2.1/os-volumes/02966eb1-b6f7-4be4-b5de-76169bc0bc5d => generated 351 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:22:45.561165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fa252c7f-3b81-411b-b463-f84c59e3c119 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a4772670>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:45.884595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fa252c7f-3b81-411b-b463-f84c59e3c119 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.328643 Sep 15 04:22:45.887969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 27/36] 10.222.0.37 () {58 vars in 1134 bytes} [Wed Sep 15 04:22:45 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:45.914504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:45.919164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:45.934318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:45.937286 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:45.938945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:45.941675 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:46.159216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:46.171928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a1f92175-3126-4029-af24-fb944bccf273 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1273 microversion: 2.1 time: 0.267966 Sep 15 04:22:46.174595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 28/37] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:45 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1273 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:46.179310 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07f6478c-005c-4650-a5f9-054450270262 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a4763f70>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:46.485351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07f6478c-005c-4650-a5f9-054450270262 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.289870 Sep 15 04:22:46.485351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 29/38] 10.222.0.37 () {58 vars in 1149 bytes} [Wed Sep 15 04:22:46 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:46.485351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-667017d3-e696-46b9-9dae-4692719fa6c8 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a46b3670>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:46.753635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-667017d3-e696-46b9-9dae-4692719fa6c8 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.274966 Sep 15 04:22:46.765721 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 30/39] 10.222.0.37 () {58 vars in 1134 bytes} [Wed Sep 15 04:22:46 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:46.778230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-dd1398fd-337e-45bf-96c3-fb6a4d1479c5 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a46c4dc0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:47.130490 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-dd1398fd-337e-45bf-96c3-fb6a4d1479c5 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.363099 Sep 15 04:22:47.139991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 31/40] 10.222.0.37 () {58 vars in 1167 bytes} [Wed Sep 15 04:22:46 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:47.146845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8784cf7b-b7f6-4386-b960-3a9a1c6538d1 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a47635e0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:47.362559 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:47.371060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:47.411705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ba702478-6859-4249-9bea-5847437d3fdb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 2.915025 Sep 15 04:22:47.421715 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 10/41] 10.222.0.37 () {60 vars in 1158 bytes} [Wed Sep 15 04:22:44 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 2926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:47.436085 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8784cf7b-b7f6-4386-b960-3a9a1c6538d1 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.294469 Sep 15 04:22:47.444328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 32/42] 10.222.0.37 () {58 vars in 1170 bytes} [Wed Sep 15 04:22:47 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:47.445051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:47.447417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:47.451451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f6e6d6c9-d5b8-47c0-8321-dcc2a918cb16 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a51def70>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:47.455155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:47.455798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:47.457330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:47.458130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:47.654945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f6e6d6c9-d5b8-47c0-8321-dcc2a918cb16 tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.207468 Sep 15 04:22:47.656212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 33/43] 10.222.0.37 () {58 vars in 1155 bytes} [Wed Sep 15 04:22:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:22:47.668378 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-98b1bc6f-ba8a-4fd2-bf77-ce7e82ca54aa tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a46c4550>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:47.914718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-98b1bc6f-ba8a-4fd2-bf77-ce7e82ca54aa tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.250523 Sep 15 04:22:47.922542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 34/44] 10.222.0.37 () {58 vars in 1188 bytes} [Wed Sep 15 04:22:47 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:47.928664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c269eb59-638e-4dfa-a919-05903a40711f tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] Calling method '.version_select at 0x7f02a46c4e50>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:48.167181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c269eb59-638e-4dfa-a919-05903a40711f tempest-VolumesTestJSON-1002613679 tempest-VolumesTestJSON-1002613679-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.241016 Sep 15 04:22:48.172174 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 35/45] 10.222.0.37 () {58 vars in 1155 bytes} [Wed Sep 15 04:22:47 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:48.486427 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:48.502094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4ac8e397-a0ea-472b-ac05-59627e82902e tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 1.076448 Sep 15 04:22:48.506725 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 11/46] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:47 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:48.994210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: .version_select at 0x7f02a46b38b0>, body: {"keypair": {"name": "tempest-keypair-1091657709"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:49.215870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:49.240006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:49.524735 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:49.526274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:49.550159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:49.553072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:49.554631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:49.556373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:49.757086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:49.767786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:49.788070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-488c2d36-77fe-4b6b-a5d9-130fc71129aa tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 1.097882 Sep 15 04:22:49.797457 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 36/47] 10.222.0.37 () {62 vars in 1199 bytes} [Wed Sep 15 04:22:48 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1100 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 15 04:22:51.612647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:51.624327 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4096ebad-5eee-4fdb-9f2b-877dc8dfd28a tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 2.104234 Sep 15 04:22:51.624906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 12/48] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:49 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 2106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:52.642943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:52.645139 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:52.659232 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:52.659816 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:52.660674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:52.664762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:54.179097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1407449406", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ee31186-826a-42f7-9fef-c5830c0b844d"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:54.259315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] validate_networks() for [('0ee31186-826a-42f7-9fef-c5830c0b844d', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:22:55.124642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:55.128019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3e491291-925f-41a9-96ff-0534c2dfcceb tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 2.488187 Sep 15 04:22:55.129989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 37/49] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:52 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:55.403496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-0ca5d292-b991-4c83-a796-918ea4cd23d5 req-2f76d2ea-97ab-42b8-a1d2-7105f77e110e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11ffcda-8f26-4200-880f-c6fbf188e809", "tag": "308b8799-f8c1-4b1a-aa1e-f94166516ab3"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:55.408027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:22:55.408027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:22:55.445166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-0ca5d292-b991-4c83-a796-918ea4cd23d5 req-2f76d2ea-97ab-42b8-a1d2-7105f77e110e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:55.445634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-0ca5d292-b991-4c83-a796-918ea4cd23d5 req-2f76d2ea-97ab-42b8-a1d2-7105f77e110e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:55.524710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-0ca5d292-b991-4c83-a796-918ea4cd23d5 req-2f76d2ea-97ab-42b8-a1d2-7105f77e110e service nova] Creating event network-changed:308b8799-f8c1-4b1a-aa1e-f94166516ab3 for instance f11ffcda-8f26-4200-880f-c6fbf188e809 on hv-cinder-76015 Sep 15 04:22:55.526051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-0ca5d292-b991-4c83-a796-918ea4cd23d5 req-2f76d2ea-97ab-42b8-a1d2-7105f77e110e service nova] Acquired lock "compute-rpcapi-router" {{(pid=108182) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 04:22:55.530507 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:55.533344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:55.535360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:55.537417 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:55.566249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.compute.rpcapi [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 15 04:22:55.570723 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] Releasing lock "compute-rpcapi-router" {{(pid=108182) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 04:22:55.632917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-37ddd2b0-899d-45c4-9f27-bf4ba1d7c0ad None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.499272 Sep 15 04:22:55.634773 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 38/50] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:22:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:22:56.150484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:56.152422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:56.173777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:56.175268 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:56.178753 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:56.179345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:58.345483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:22:58.346578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:22:58.347360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:22:58.347963 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:22:58.348677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:22:58.366654 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:58.373319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:58.374857 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:58.379609 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:58.424305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Getting quotas for project 774cd86cad2f4d7a9ebe2a9ff8223570. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:22:58.431404 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Getting quotas for user 304734511d4f4c85af12772a26505629 and project 774cd86cad2f4d7a9ebe2a9ff8223570. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:22:58.461894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:22:58.470158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:22:58.616368 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-124e7a98-3e3b-43ce-bbfa-8db28960939c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.669947 Sep 15 04:22:58.634011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 13/51] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:22:52 2021] POST /compute/v2.1/servers => generated 383 bytes in 5688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:22:58.683870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-49bc5af0-e272-47e6-82f7-b7541ad62f11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:58.687152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-49bc5af0-e272-47e6-82f7-b7541ad62f11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:58.751404 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:58.765509 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-461cc881-c61e-44ef-8b39-65e234b767a2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 2.622010 Sep 15 04:22:58.774076 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 39/52] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:56 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:59.118615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-49bc5af0-e272-47e6-82f7-b7541ad62f11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:22:59.137878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-49bc5af0-e272-47e6-82f7-b7541ad62f11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1222 microversion: 2.1 time: 0.491263 Sep 15 04:22:59.149252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 14/53] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:58 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1222 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:22:59.353537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1357033886", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ee31186-826a-42f7-9fef-c5830c0b844d"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:22:59.542634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] validate_networks() for [('0ee31186-826a-42f7-9fef-c5830c0b844d', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:22:59.790451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:22:59.791154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:22:59.802604 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:59.804288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:22:59.806609 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:22:59.808389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:00.948075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:00.958134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7ec6f387-f9b3-4526-8efb-e1dc59769ef9 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 1.171479 Sep 15 04:23:00.959327 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 15/54] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:22:59 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:01.975966 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:01.977200 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:01.987037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:01.989094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:01.991708 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:01.992361 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:02.324795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:02.343638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b985735e-4f46-47eb-8a43-eee585a4882f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 0.371718 Sep 15 04:23:02.345854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 16/55] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:01 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:02.362542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1651327123", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d61962a-5e93-4ef1-8adc-7c1123313d47"}], "security_groups": [{"name": "tempest-securitygroup--1132937818"}], "key_name": "tempest-keypair-204474707", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:02.650339 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] validate_networks() for [('0d61962a-5e93-4ef1-8adc-7c1123313d47', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:23:03.114936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:23:03.116415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:23:03.117175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:23:03.118430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:23:03.119682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:23:03.131441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.131897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.132391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.133175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.164212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Getting quotas for project 774cd86cad2f4d7a9ebe2a9ff8223570. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:23:03.169844 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Getting quotas for user 304734511d4f4c85af12772a26505629 and project 774cd86cad2f4d7a9ebe2a9ff8223570. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:23:03.182670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:23:03.186426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:23:03.311671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fa9bb264-1479-48ea-a0bf-2b2c0d68c3b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.962323 Sep 15 04:23:03.312755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 40/56] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:22:59 2021] POST /compute/v2.1/servers => generated 383 bytes in 3964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:23:03.655669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:23:03.656745 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:23:03.657607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:23:03.658298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:23:03.658869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:23:03.675159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.675640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.677053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.677517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.716009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:23:03.719896 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:23:03.739502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:23:03.743225 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:23:03.821172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d9d225fc-740d-4e4e-a7cf-6dd51f0fdafa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.463921 Sep 15 04:23:03.822996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 17/57] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:23:02 2021] POST /compute/v2.1/servers => generated 402 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:23:03.828626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:03.829728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:03.852581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.856150 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.857070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.857603 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.969000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-2ef28c76-4126-4212-a7a7-3ec1504780ff req-97296d27-eb5f-4297-b887-5b0acdbc2bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11ffcda-8f26-4200-880f-c6fbf188e809", "name": "network-vif-plugged", "status": "completed", "tag": "308b8799-f8c1-4b1a-aa1e-f94166516ab3"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:03.970967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:03.970967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:03.975152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:03.986771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2ef28c76-4126-4212-a7a7-3ec1504780ff req-97296d27-eb5f-4297-b887-5b0acdbc2bd1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:03.987041 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3f8daf5d-a84b-4e84-a1a3-3a553e02cf51 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1226 microversion: 2.1 time: 0.159926 Sep 15 04:23:03.987239 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2ef28c76-4126-4212-a7a7-3ec1504780ff req-97296d27-eb5f-4297-b887-5b0acdbc2bd1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:03.987748 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 18/58] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:03 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1226 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:03.998320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:03.999162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:04.007959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:04.007959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:04.008480 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:04.008943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:04.026329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-2ef28c76-4126-4212-a7a7-3ec1504780ff req-97296d27-eb5f-4297-b887-5b0acdbc2bd1 service nova] Creating event network-vif-plugged:308b8799-f8c1-4b1a-aa1e-f94166516ab3 for instance f11ffcda-8f26-4200-880f-c6fbf188e809 on hv-cinder-76015 Sep 15 04:23:04.040123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-2ef28c76-4126-4212-a7a7-3ec1504780ff req-97296d27-eb5f-4297-b887-5b0acdbc2bd1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.718925 Sep 15 04:23:04.046488 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 41/59] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:04.054095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1632582346", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25bc0a6f-df06-4b45-a772-55a6cdb78da7"}], "security_groups": [{"name": "tempest-securitygroup--1534603662"}], "key_name": "tempest-keypair-1091657709", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:04.307635 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:04.317001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9f481e2b-6834-47f0-a414-34e097ccd010 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 0.327408 Sep 15 04:23:04.320017 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 19/60] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:03 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:04.336930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c36b6f7f-84c1-49d9-85d4-e866f317e9a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:04.337792 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c36b6f7f-84c1-49d9-85d4-e866f317e9a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:04.459383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c36b6f7f-84c1-49d9-85d4-e866f317e9a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:04.475346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c36b6f7f-84c1-49d9-85d4-e866f317e9a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1237 microversion: 2.1 time: 0.147538 Sep 15 04:23:04.480388 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 20/61] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:04 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:04.685282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] validate_networks() for [('25bc0a6f-df06-4b45-a772-55a6cdb78da7', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:23:05.009479 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:05.011397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:05.020646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.023040 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.024119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.024953 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.285521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:05.294500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e387d333-608c-4ffc-8117-41f898260e1c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1280 microversion: 2.1 time: 0.293388 Sep 15 04:23:05.296613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 21/62] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:04 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1280 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:05.301845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-c5335104-859e-49cd-b7e0-01108cb601bf req-19bfb535-9f7f-45d8-ac5d-3a9400800a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76d0ff04-6f6c-469a-b96d-0a01ba58779e", "tag": "0fba4829-f68e-4f8d-baae-e9f6e4cebcab"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:05.304207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:05.304207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:05.315828 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c5335104-859e-49cd-b7e0-01108cb601bf req-19bfb535-9f7f-45d8-ac5d-3a9400800a10 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.316534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c5335104-859e-49cd-b7e0-01108cb601bf req-19bfb535-9f7f-45d8-ac5d-3a9400800a10 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.342311 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-c5335104-859e-49cd-b7e0-01108cb601bf req-19bfb535-9f7f-45d8-ac5d-3a9400800a10 service nova] Creating event network-changed:0fba4829-f68e-4f8d-baae-e9f6e4cebcab for instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e on hv-cinder-76015 Sep 15 04:23:05.343052 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c5335104-859e-49cd-b7e0-01108cb601bf req-19bfb535-9f7f-45d8-ac5d-3a9400800a10 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108181) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 15 04:23:05.344649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.345278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.346315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.347123 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.361995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.compute.rpcapi [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Sep 15 04:23:05.363529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] Releasing lock "compute-rpcapi-router" {{(pid=108181) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 15 04:23:05.428296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-161fcfef-85e8-4086-80b1-5a93ce93f99d None None] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130200 Sep 15 04:23:05.429212 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 22/63] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:05.434581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:05.435622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:05.443862 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.444575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:05.445734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:05.446773 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.236736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.246804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-49d2b7a6-c666-4409-a850-1772bf3c5348 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 0.815954 Sep 15 04:23:06.259967 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 23/64] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:05 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:06.267721 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:06.268922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:06.277603 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.278238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.279667 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.280534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.431013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.452097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3c3719af-684e-4012-9903-6ae16d80b9ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1295 microversion: 2.1 time: 0.180157 Sep 15 04:23:06.454194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 24/65] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:06 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1295 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:06.468036 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:23:06.468517 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:23:06.468933 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:23:06.469520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:23:06.469948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:23:06.476330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:06.480694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:06.485743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.486384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.487369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.487947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.506026 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.510915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.514212 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:06.519553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:06.529237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:23:06.538725 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:23:06.571210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:23:06.573965 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:23:06.663345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-77e71b03-c7fc-4a36-92f6-7d9102bbda94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.614730 Sep 15 04:23:06.664343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 42/66] 10.222.0.37 () {62 vars in 1188 bytes} [Wed Sep 15 04:23:04 2021] POST /compute/v2.1/servers => generated 402 bytes in 2617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 04:23:06.678627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:06.679496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:06.748550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.764845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-57f976dc-b9b5-4f18-ad03-9b611ce326c1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1280 microversion: 2.1 time: 0.306975 Sep 15 04:23:06.774282 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 25/67] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:06 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1280 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:06.911352 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.940502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.944712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:06.958794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0835c8dc-3c22-4cf8-837c-d98aabc6237f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1282 microversion: 2.20 time: 0.276028 Sep 15 04:23:06.975433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 43/68] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:06 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1282 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:07.266633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:07.267423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:07.291445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:07.292044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:07.292811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:07.293287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:07.472863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:07.475453 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:07.487646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:07.489049 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:07.500854 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:07.503860 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:08.245108 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:08.255521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bd51db3e-4259-41ed-92b7-7db84908f951 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1315 microversion: 2.1 time: 0.992025 Sep 15 04:23:08.256742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 26/69] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:07 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:08.263432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:08.264519 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:08.284550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:08.287205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:08.288457 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:08.289113 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:08.359212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:08.368712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-387357e4-c409-4460-ad3a-a9316e79e1a0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.900978 Sep 15 04:23:08.374369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 44/70] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:07 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:08.383959 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:08.385875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:08.402061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:08.402794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:08.404198 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:08.405939 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:08.593384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:08.615848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:08.617877 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:08.627373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-208cdb76-18ad-40e8-b258-0e3129478865 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1334 microversion: 2.20 time: 0.246103 Sep 15 04:23:08.629833 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 45/71] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:08 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1334 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:09.008268 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.018509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-24940143-579f-4098-855a-95262f9208d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.757262 Sep 15 04:23:09.021082 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 27/72] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:08 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:09.278991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:09.279796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:09.291295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.295034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.296042 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.297151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.401105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:09.402035 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:09.422595 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.423877 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.424847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.425429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.620201 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.629659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fafc85a1-7494-4304-822e-50f427c696f4 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1502 microversion: 2.1 time: 0.359983 Sep 15 04:23:09.633693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 46/73] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:09 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1502 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:09.718233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-e40f6857-76c3-446d-8f02-8705bfc297f4 req-3eb3ea5e-609d-4ff1-8c9e-88ef3d4ea0fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a894d8-561b-4dfb-9240-5df7076fcd2d", "tag": "e7b06ebb-1f13-4862-a414-fb3771962da1"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:09.719822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:09.719822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:09.727565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e40f6857-76c3-446d-8f02-8705bfc297f4 req-3eb3ea5e-609d-4ff1-8c9e-88ef3d4ea0fc service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.728267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e40f6857-76c3-446d-8f02-8705bfc297f4 req-3eb3ea5e-609d-4ff1-8c9e-88ef3d4ea0fc service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.743634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-e40f6857-76c3-446d-8f02-8705bfc297f4 req-3eb3ea5e-609d-4ff1-8c9e-88ef3d4ea0fc service nova] Creating event network-changed:e7b06ebb-1f13-4862-a414-fb3771962da1 for instance 95a894d8-561b-4dfb-9240-5df7076fcd2d on hv-cinder-76015 Sep 15 04:23:09.744790 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.749248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-e40f6857-76c3-446d-8f02-8705bfc297f4 req-3eb3ea5e-609d-4ff1-8c9e-88ef3d4ea0fc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114393 Sep 15 04:23:09.752415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 47/74] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:09.755624 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-023dcd65-e318-4d2d-abae-410ff66bfdb6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.365109 Sep 15 04:23:09.760650 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:09.761581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:09.765520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 28/75] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:09 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:09.770412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.771717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.772665 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.773356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.884480 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-edd775dd-e98f-44f2-b7f3-7d5a27ce3c21 req-8a974abf-ebc8-4138-a7f9-0522ddd467a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faf84e01-9ef8-4f6e-95b7-118c0e68eb71", "tag": "b0ed4920-f031-4c30-8129-6e8e39e547fb"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:09.886520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:09.886520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:09.889679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.896960 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-edd775dd-e98f-44f2-b7f3-7d5a27ce3c21 req-8a974abf-ebc8-4138-a7f9-0522ddd467a3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:09.897823 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-edd775dd-e98f-44f2-b7f3-7d5a27ce3c21 req-8a974abf-ebc8-4138-a7f9-0522ddd467a3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:09.901086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.902594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:09.903760 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c99cdb9c-39fa-448b-a9f9-70f9841d768a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1340 microversion: 2.20 time: 0.150422 Sep 15 04:23:09.904320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 48/76] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:09 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1340 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:09.917638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-edd775dd-e98f-44f2-b7f3-7d5a27ce3c21 req-8a974abf-ebc8-4138-a7f9-0522ddd467a3 service nova] Creating event network-changed:b0ed4920-f031-4c30-8129-6e8e39e547fb for instance faf84e01-9ef8-4f6e-95b7-118c0e68eb71 on hv-cinder-76015 Sep 15 04:23:09.924140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-edd775dd-e98f-44f2-b7f3-7d5a27ce3c21 req-8a974abf-ebc8-4138-a7f9-0522ddd467a3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042316 Sep 15 04:23:09.924971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 29/77] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:23:10.041264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:10.041883 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:10.048126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.048898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:10.049839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.050380 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:10.174856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:10.182407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8864616b-5fbb-4614-9b90-36748ffa82cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.145053 Sep 15 04:23:10.182974 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 49/78] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:10 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:10.773283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:10.773924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:10.780539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.780999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:10.781795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.782243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:10.912728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:10.920475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-48547124-a8dd-42c9-b304-be4b85c95b8c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.151516 Sep 15 04:23:10.921100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 30/79] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:10 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:10.921851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:10.922475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:10.929677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.930135 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:10.931074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:10.931550 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:11.007709 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:11.015456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:11.017183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:11.018364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d73dda76-991b-4972-93ad-e9a5184fc6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1340 microversion: 2.20 time: 0.100165 Sep 15 04:23:11.018961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 50/80] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:10 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1340 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:11.200839 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:11.201454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:11.207978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:11.208503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:11.209432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:11.210080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:11.346019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:11.354627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-56439d44-8e9f-4f43-81c1-49deb6f7d2e1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.157531 Sep 15 04:23:11.355886 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 31/81] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:11 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:11.941764 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:11.942590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:11.965348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:11.966609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:11.972377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:11.975753 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.039342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:12.040602 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:12.065020 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.065534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.067020 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.067497 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.227416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:12.237027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:12.239833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:12.246582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1a36226c-a8ca-494d-baa8-e2f7dfe8b285 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1340 microversion: 2.20 time: 0.212437 Sep 15 04:23:12.247193 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 32/82] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:12 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1340 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:12.253504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8a26676-c682-4c42-b74a-e884ff60bde6"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:12.255437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:12.263249 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.263975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.265223 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.265984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.867746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:12.885619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b9e7b64e-2f56-480a-8248-db4f6269ee92 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.950690 Sep 15 04:23:12.888368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 51/83] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:11 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:12.899877 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:12.900859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:12.908145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.909244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:12.911478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:12.942138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:13.134393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2ac693e3-aa6d-4903-b340-6f4efa578b9f tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "POST /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876763 Sep 15 04:23:13.136758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 33/84] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:23:12 2021] POST /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809/os-volume_attachments => generated 194 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:13.274353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:13.275644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:13.289509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:13.290711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:13.291965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:13.293001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:13.431441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:13.442716 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:13.444615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:13.444979 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:13.446650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a5458600-5563-4ad5-8b71-41c31961742d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1340 microversion: 2.20 time: 0.181548 Sep 15 04:23:13.448088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 34/85] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:13 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1340 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:13.452941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3203f797-e356-4f58-a879-0084756a1397 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.560606 Sep 15 04:23:13.463504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 52/86] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:12 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:13.656161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-47607c01-8029-4971-bc38-d5b1eae0ebdb req-14a7ec2f-abb7-473e-94bd-9959c46c1a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d0ff04-6f6c-469a-b96d-0a01ba58779e", "name": "network-vif-plugged", "status": "completed", "tag": "0fba4829-f68e-4f8d-baae-e9f6e4cebcab"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:13.658157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:13.658157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:13.672985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-47607c01-8029-4971-bc38-d5b1eae0ebdb req-14a7ec2f-abb7-473e-94bd-9959c46c1a57 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:13.673616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-47607c01-8029-4971-bc38-d5b1eae0ebdb req-14a7ec2f-abb7-473e-94bd-9959c46c1a57 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:13.702645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-47607c01-8029-4971-bc38-d5b1eae0ebdb req-14a7ec2f-abb7-473e-94bd-9959c46c1a57 service nova] Creating event network-vif-plugged:0fba4829-f68e-4f8d-baae-e9f6e4cebcab for instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e on hv-cinder-76015 Sep 15 04:23:13.711449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-47607c01-8029-4971-bc38-d5b1eae0ebdb req-14a7ec2f-abb7-473e-94bd-9959c46c1a57 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059060 Sep 15 04:23:13.714656 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 35/87] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:23:13.913441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:13.914213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:13.920312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:13.922742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:13.924081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:13.924732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:14.370892 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:14.385586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f940f4a5-8857-4ae0-b1b8-dae9b3da711f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.476548 Sep 15 04:23:14.386814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 53/88] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:13 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:14.472703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:14.475697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:14.476177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:14.476392 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:14.484647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:14.485385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:14.486941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:14.487110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:14.487449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:14.487558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:14.488403 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:14.488839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:14.869079 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:14.884737 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:14.887285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:14.888574 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0cf51cc8-7886-4b11-a747-08e42f0f5d19 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.424858 Sep 15 04:23:14.890623 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 36/89] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:14 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:14.945487 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:14.953565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-818ee4fe-38e3-43dd-9cd3-3233c7c8ee60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.487414 Sep 15 04:23:14.959167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 54/90] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:14 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:15.286393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-3c587e21-0ee8-48b4-b055-56c183301612 req-95ed18b5-9b1d-44b1-a0ad-a94023d70942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:15.288432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:15.288432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:15.299137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-3c587e21-0ee8-48b4-b055-56c183301612 req-95ed18b5-9b1d-44b1-a0ad-a94023d70942 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.299569 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-3c587e21-0ee8-48b4-b055-56c183301612 req-95ed18b5-9b1d-44b1-a0ad-a94023d70942 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.312550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-3c587e21-0ee8-48b4-b055-56c183301612 req-95ed18b5-9b1d-44b1-a0ad-a94023d70942 service nova] Creating event network-changed:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:23:15.317801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-3c587e21-0ee8-48b4-b055-56c183301612 req-95ed18b5-9b1d-44b1-a0ad-a94023d70942 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035367 Sep 15 04:23:15.318956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 37/91] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:15.402543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:15.403856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:15.421010 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.421730 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.422706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.424772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.732110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:15.740984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-30300f13-26f6-42a7-842c-4093889c2e03 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.341984 Sep 15 04:23:15.751181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 55/92] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:15 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:15.909294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:15.910082 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:15.917912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.918372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.919174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.919701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.974867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:15.975508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:15.982587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.983261 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:15.984921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:15.985728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:16.420363 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:16.433984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:16.437861 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:16.443868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-54a9099d-4f7f-4f8e-88e9-14e79abc793d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.536733 Sep 15 04:23:16.446004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 38/93] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:15 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:16.470146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:16.481536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fe67983d-772c-4942-b238-920be08711a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.510250 Sep 15 04:23:16.494436 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 56/94] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:15 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:16.761162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:16.762423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:16.769110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:16.769681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:16.770468 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:16.770904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:16.970883 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:16.983170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bcc773da-c08f-4ac0-aa8e-33c27f500d8a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.226076 Sep 15 04:23:16.984381 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 39/95] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:16 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:17.465519 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:17.466139 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:17.472936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:17.474098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:17.474886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:17.475355 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:17.499914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:17.500641 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:17.506702 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:17.507260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:17.508110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:17.508565 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:17.682313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:17.684781 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:17.703776 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:17.703776 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:17.703776 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e477792a-25fb-4445-baa6-22d948066440 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.236947 Sep 15 04:23:17.704046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 57/96] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:17 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:17.704957 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8a5eaeb8-c5dd-4beb-ad4a-5bc67d08f9be tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.208507 Sep 15 04:23:17.705707 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 40/97] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:17 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:18.000296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:18.001006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:18.007481 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.008007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.008863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.009450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.152640 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:18.169335 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d19aa72c-728c-4e25-b1e5-689e5f534b8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.171694 Sep 15 04:23:18.181330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 58/98] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:17 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:18.717230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:18.717230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:18.722005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:18.722619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:18.722754 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.723058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.723855 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.724287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.728292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.728738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.729503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:18.729929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:18.900306 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:18.905008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:18.908018 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:18.909512 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:18.911176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5292a187-d303-441e-b597-ed2b8182c856 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.198792 Sep 15 04:23:18.911756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 41/99] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:18 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:18.912948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b29481ec-be1d-4c60-937d-6f15e121ae4b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.194476 Sep 15 04:23:18.913497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 59/100] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:18 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:19.187714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:19.188402 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:19.195524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.195974 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:19.196780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.197212 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:19.322014 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:19.331600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-12bb20c0-e052-4194-ab77-f053c678a01c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.147711 Sep 15 04:23:19.332663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 42/101] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:19 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:19.929702 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:19.930348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:19.930693 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:19.930778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:19.936621 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.937347 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.937450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:19.937806 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:19.938307 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.938586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:19.938872 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:19.939244 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:20.114408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:20.121796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5887f546-a012-4de0-8082-a7c20cd02711 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.195866 Sep 15 04:23:20.122368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 60/102] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:19 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:20.126329 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:20.126899 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-b390b52d-14d2-4d21-9fd3-604a36754d3d req-c615bd4c-ee9b-49bc-8aad-383b0050b88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a894d8-561b-4dfb-9240-5df7076fcd2d", "name": "network-vif-plugged", "status": "completed", "tag": "e7b06ebb-1f13-4862-a414-fb3771962da1"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:20.129316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:20.129316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:20.134853 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:20.136373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:20.136485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-b390b52d-14d2-4d21-9fd3-604a36754d3d req-c615bd4c-ee9b-49bc-8aad-383b0050b88a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:20.136831 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-b390b52d-14d2-4d21-9fd3-604a36754d3d req-c615bd4c-ee9b-49bc-8aad-383b0050b88a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:20.137475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bb338b42-31f3-4e3a-9fdf-7e5b64035453 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.211606 Sep 15 04:23:20.138074 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 43/103] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:19 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:20.149828 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-b390b52d-14d2-4d21-9fd3-604a36754d3d req-c615bd4c-ee9b-49bc-8aad-383b0050b88a service nova] Creating event network-vif-plugged:e7b06ebb-1f13-4862-a414-fb3771962da1 for instance 95a894d8-561b-4dfb-9240-5df7076fcd2d on hv-cinder-76015 Sep 15 04:23:20.154839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-b390b52d-14d2-4d21-9fd3-604a36754d3d req-c615bd4c-ee9b-49bc-8aad-383b0050b88a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031340 Sep 15 04:23:20.155512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 61/104] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:20.354706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:20.355836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:20.367898 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:20.369002 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:20.370441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:20.371220 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:20.534345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:20.541849 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-45236f3e-7557-4459-a686-e72d5bbc8ab5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.195026 Sep 15 04:23:20.542420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 44/105] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:20 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:21.139611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:21.140315 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:21.146244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.146692 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.147489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.147929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.155292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:21.155894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:21.163058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.163731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.164741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.165252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.343936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:21.355316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b56d123c-f2c7-4a56-ae25-33b1ccf29be8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.219495 Sep 15 04:23:21.357348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:21.365556 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 62/106] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:21 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:21.378369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:21.380370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:21.381668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cb05cc53-cbcb-4546-adec-668e6972c9c3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.230150 Sep 15 04:23:21.382851 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 45/107] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:21 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:21.562334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:21.563299 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:21.571512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.572657 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.573450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:21.573885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:21.790210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:21.797849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-78e6d699-e0aa-478c-9137-546c883c1fbe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.240684 Sep 15 04:23:21.798420 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 63/108] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:21 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:22.372743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:22.373498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:22.379829 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.380351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.381333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.381753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.400083 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:22.400694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:22.407072 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.407847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.417469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.418005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.580777 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:22.588859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-16ce697c-0517-4b2c-a628-85d4f28adf00 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.219745 Sep 15 04:23:22.589726 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 46/109] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:22 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:22.602264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:22.610206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:22.611784 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:22.612941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2a76e7f6-ee6a-45de-8d28-d2d31df2ff1f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.216582 Sep 15 04:23:22.613486 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 64/110] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:22 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:22.815214 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:22.815214 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:22.820916 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.821397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.822216 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:22.822668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:22.985494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:22.994769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-37a020d8-21b5-4bf5-8782-34f19c5445f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.184369 Sep 15 04:23:22.995559 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 47/111] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:22 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:23.605896 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:23.606537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:23.612498 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:23.612964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:23.613817 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:23.614246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:23.630816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:23.631464 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:23.637966 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:23.638599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:23.639583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:23.640022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:23.850426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:23.858035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0194c0bb-c36b-4da6-a79b-a46cf9ac577c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.255677 Sep 15 04:23:23.858776 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 65/112] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:23 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:23.880923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:23.899412 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:23.901097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:23.902241 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-23640805-f824-4f70-bfa6-be73d64c0c14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.275922 Sep 15 04:23:23.902798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 48/113] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:23 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:24.013302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:24.014098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:24.020848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.021664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.022619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.023399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.192376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:24.202587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f12f01db-e060-4845-b064-dbae0e4d7fe4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1363 microversion: 2.1 time: 0.193492 Sep 15 04:23:24.215055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 66/114] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:24 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:24.230616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-902a0f37-329a-46f7-812d-b14ab9f89eb8 req-15fe5eaa-4aa5-4f6b-bae5-18fcb73694f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf84e01-9ef8-4f6e-95b7-118c0e68eb71", "name": "network-vif-plugged", "status": "completed", "tag": "b0ed4920-f031-4c30-8129-6e8e39e547fb"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:24.232795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:24.232795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:24.244321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-902a0f37-329a-46f7-812d-b14ab9f89eb8 req-15fe5eaa-4aa5-4f6b-bae5-18fcb73694f5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.245738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-902a0f37-329a-46f7-812d-b14ab9f89eb8 req-15fe5eaa-4aa5-4f6b-bae5-18fcb73694f5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.275863 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-902a0f37-329a-46f7-812d-b14ab9f89eb8 req-15fe5eaa-4aa5-4f6b-bae5-18fcb73694f5 service nova] Creating event network-vif-plugged:b0ed4920-f031-4c30-8129-6e8e39e547fb for instance faf84e01-9ef8-4f6e-95b7-118c0e68eb71 on hv-cinder-76015 Sep 15 04:23:24.289072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-902a0f37-329a-46f7-812d-b14ab9f89eb8 req-15fe5eaa-4aa5-4f6b-bae5-18fcb73694f5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062150 Sep 15 04:23:24.290678 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 49/115] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:24.875503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:24.876647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:24.882508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.882966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.883787 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.884221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.937994 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:24.938767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:24.956221 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.956913 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:24.963547 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:24.964011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.053470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:25.063351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f6ebb254-eb1c-43ef-b922-35a9ae6c9dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1322 microversion: 2.1 time: 0.191772 Sep 15 04:23:25.067894 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 67/116] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:24 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:25.181132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:25.190557 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:25.193089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:25.194515 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b92a2420-7a13-4a00-8448-f2ead809370a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.268802 Sep 15 04:23:25.195070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 50/117] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:24 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:25.220655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:25.221400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:25.231157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.231835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.232637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.233080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.370465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:25.378577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-16ec7d22-47b8-404f-bb04-ebee5995b532 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1550 microversion: 2.1 time: 0.161498 Sep 15 04:23:25.380012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 68/118] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:25 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1550 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:25.403598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:25.404110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:25.417547 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.418344 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.419376 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.420138 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.522870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-467a71b2-2287-4875-b8a9-abbbfbfce02f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128642 Sep 15 04:23:25.523507 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 51/119] 10.222.0.37 () {58 vars in 1275 bytes} [Wed Sep 15 04:23:25 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:25.676632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-900871621", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:25.778023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:25.779490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:25.807480 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.808002 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.813105 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] validate_networks() for None {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:23:25.817927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:25.819733 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:25.908713 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:23:26.042646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9c246fbb-505e-42e6-b0ac-3fc9abbf1f43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 204 len: 0 microversion: 2.1 time: 0.270291 Sep 15 04:23:26.043426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 52/120] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:23:25 2021] DELETE /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:23:26.054056 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:26.055996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:26.066360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.068395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.070439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.071174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.231565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:23:26.232061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:23:26.232456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:23:26.233070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:23:26.234291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:23:26.250238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.251921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.253762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.254444 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.266697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.277758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-defda5dc-c8a8-4c99-a48a-5a94badcd7e7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1554 microversion: 2.1 time: 0.229393 Sep 15 04:23:26.279612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 53/121] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:26 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1554 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:26.284390 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:26.285933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:26.295773 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Getting quotas for project 432c32a8889b45fbbbc84311cedc9b15. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:23:26.296496 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.297091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.297914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.298537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.300337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Getting quotas for user 1c1aa812b60f4f72bff98903e022d254 and project 432c32a8889b45fbbbc84311cedc9b15. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:23:26.314968 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:23:26.317792 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:23:26.400259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f3b171c8-968d-47d8-9696-bdaf89661048 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.729555 Sep 15 04:23:26.401245 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 69/122] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:23:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:23:26.405688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:26.406748 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:26.413242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.413930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.415024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.415492 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.510351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.522884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0ffc4cbf-0332-4d89-b7fa-b34ab4471e43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1516 microversion: 2.1 time: 0.237215 Sep 15 04:23:26.525895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 54/123] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:26 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:26.532724 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-371d9198-ab8e-4c32-a6d1-008951298034 req-79b3b3f8-16bc-4490-9501-03cdb515280e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "name": "network-vif-plugged", "status": "completed", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:26.534316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:26.534316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:26.559658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-371d9198-ab8e-4c32-a6d1-008951298034 req-79b3b3f8-16bc-4490-9501-03cdb515280e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.560731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-371d9198-ab8e-4c32-a6d1-008951298034 req-79b3b3f8-16bc-4490-9501-03cdb515280e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.609165 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-371d9198-ab8e-4c32-a6d1-008951298034 req-79b3b3f8-16bc-4490-9501-03cdb515280e service nova] Creating event network-vif-plugged:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:23:26.617765 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-371d9198-ab8e-4c32-a6d1-008951298034 req-79b3b3f8-16bc-4490-9501-03cdb515280e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089979 Sep 15 04:23:26.618567 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 55/124] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:26.624555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5941373d-a084-456e-8afb-377ce941de60 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:26.625487 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5941373d-a084-456e-8afb-377ce941de60 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:26.666360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.675835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.682184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.683409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-87d42d40-9368-422b-9a83-8fa129edcad0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.281144 Sep 15 04:23:26.683937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 70/125] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:26 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:26.692826 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:26.702377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:26.720487 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.721195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.722713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:26.723395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:26.744039 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5941373d-a084-456e-8afb-377ce941de60 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:26.754680 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5941373d-a084-456e-8afb-377ce941de60 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1214 microversion: 2.1 time: 0.134740 Sep 15 04:23:26.756088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 56/126] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:26 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:26.845256 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lazy-loading 'flavor' on Instance uuid faf84e01-9ef8-4f6e-95b7-118c0e68eb71 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:23:27.013095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e3c73adf-3baa-442d-a969-8f4f635e3542 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71/action" status: 200 len: 32 microversion: 2.1 time: 0.324548 Sep 15 04:23:27.013706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 71/127] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:26 2021] POST /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:27.023305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:27.024089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:27.030263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.030939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.032263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.032805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.211736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:27.221476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-62322f94-57d1-4c46-a06b-efaba617a365 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.202608 Sep 15 04:23:27.222729 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 57/128] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:27 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:27.300277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:27.302248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:27.313261 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.313985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.315180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.316842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.355699 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:27.356836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:27.364949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.367684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.368536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.369614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.462307 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f0419257-be97-4bdf-bfb5-0b540d19377f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.110445 Sep 15 04:23:27.463536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 58/129] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:27 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:27.469640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-58f83bbd-7559-4558-8ca1-93c7641eae69 req-7b28e30e-ebdc-4925-ba26-8cb02cc54258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a894d8-561b-4dfb-9240-5df7076fcd2d", "tag": "e7b06ebb-1f13-4862-a414-fb3771962da1"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:27.471216 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:27.471216 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:27.483201 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-58f83bbd-7559-4558-8ca1-93c7641eae69 req-7b28e30e-ebdc-4925-ba26-8cb02cc54258 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.484260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-58f83bbd-7559-4558-8ca1-93c7641eae69 req-7b28e30e-ebdc-4925-ba26-8cb02cc54258 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.500202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-58f83bbd-7559-4558-8ca1-93c7641eae69 req-7b28e30e-ebdc-4925-ba26-8cb02cc54258 service nova] Creating event network-changed:e7b06ebb-1f13-4862-a414-fb3771962da1 for instance 95a894d8-561b-4dfb-9240-5df7076fcd2d on hv-cinder-76015 Sep 15 04:23:27.506833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-58f83bbd-7559-4558-8ca1-93c7641eae69 req-7b28e30e-ebdc-4925-ba26-8cb02cc54258 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041743 Sep 15 04:23:27.507852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 59/130] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:27.702286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:27.703462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:27.711162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.714130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.715462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.718912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.929080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:27.950956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-43de2af9-29a0-47be-88e5-fc9d423c4ac7 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1554 microversion: 2.1 time: 0.656913 Sep 15 04:23:27.951908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 72/131] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:27 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1554 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:27.960591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:27.961742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:27.976989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.977659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:27.978695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:27.979313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.186287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:28.197252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7eb0caec-2a04-4bc2-b2b8-4381246d0730 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1266 microversion: 2.1 time: 0.244264 Sep 15 04:23:28.198069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 73/132] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:27 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:28.240092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:28.240922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:28.249934 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.260776 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.262329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.264008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.286058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:28.301824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:28.307335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:28.310495 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-56106896-a2cb-4961-a674-adc6ea063a55 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1408 microversion: 2.20 time: 0.612391 Sep 15 04:23:28.319931 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 60/133] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:27 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1408 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:23:28.473381 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:28.474553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:28.486885 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.490832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.494317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.495553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.623733 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fc42e11a-2b93-41cf-980b-520fbe1055d1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.154143 Sep 15 04:23:28.624370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 61/134] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:28 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:23:28.969029 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:28.970134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:28.979478 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.980323 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:28.981394 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:28.982071 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.016609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:29.031064 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e13fbc32-93b3-40d1-9783-3e1bef50f294 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.795088 Sep 15 04:23:29.044667 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 74/135] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:28 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:29.214166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:29.214827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:29.221820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.223187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.224291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.225665 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.408488 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:29.430158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c85ee3bc-2edf-4c15-9e29-9d278b505317 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1272 microversion: 2.1 time: 0.218151 Sep 15 04:23:29.434252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 75/136] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:29 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1272 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:29.455559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:29.456309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:29.468014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.470591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.471515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.474090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.522285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:29.532523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-836e97ea-caae-4f5a-9408-495eaf9360e0 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1554 microversion: 2.1 time: 0.567912 Sep 15 04:23:29.533681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 62/137] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:28 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1554 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:29.634661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:29.636101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:29.647684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.648531 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.649577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:29.650232 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:29.744869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-93c822be-798d-431e-af70-fa2ad2c9375e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.113783 Sep 15 04:23:29.748555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 63/138] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:29 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:23:30.052964 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:30.054110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:30.067242 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.068329 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.070612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.071963 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.094882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.121493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.125363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.127918 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a066ef7e-b651-4004-9049-911090966742 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1600 microversion: 2.20 time: 0.691404 Sep 15 04:23:30.128993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 76/139] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:23:29 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1600 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:23:30.148456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:30.149095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:30.161690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.163755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.164575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.165035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.356402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e73106b3-b7c0-441d-8e07-f2e76752080d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.213022 Sep 15 04:23:30.361014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 77/140] 10.222.0.37 () {60 vars in 1316 bytes} [Wed Sep 15 04:23:30 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:23:30.429100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.437690 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-615e4511-ea2c-4478-8bcc-016bc66300a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.391586 Sep 15 04:23:30.439322 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 64/141] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:30 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:30.451850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:30.452469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:30.459791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.460520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.461485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.462129 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.550749 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:30.552875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:30.561456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.562435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.568004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.568753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.662994 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c533ed3963af4efdb08c5175e17d85d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f244fd964a1e408eb0815b292899cdeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.675703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-14070bc1-415e-4efa-9cef-0ae18e153a43 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 200 len: 1512 microversion: 2.1 time: 0.129385 Sep 15 04:23:30.675938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 65/142] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:30 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:30.680856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-5f7426a9-3dbd-4a05-a180-ba6a010facd9 req-67a2215e-e2e3-41ed-b952-15f81366f2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11ffcda-8f26-4200-880f-c6fbf188e809", "name": "network-vif-deleted", "tag": "308b8799-f8c1-4b1a-aa1e-f94166516ab3"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:30.682614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:30.682614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:30.692244 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-5f7426a9-3dbd-4a05-a180-ba6a010facd9 req-67a2215e-e2e3-41ed-b952-15f81366f2b6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.695858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-5f7426a9-3dbd-4a05-a180-ba6a010facd9 req-67a2215e-e2e3-41ed-b952-15f81366f2b6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.696303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:30.705967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-92543943-c036-4e03-bfcd-9cf6e7f7987c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.257337 Sep 15 04:23:30.707719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 78/143] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:30 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:30.711173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-5f7426a9-3dbd-4a05-a180-ba6a010facd9 req-67a2215e-e2e3-41ed-b952-15f81366f2b6 service nova] Creating event network-vif-deleted:308b8799-f8c1-4b1a-aa1e-f94166516ab3 for instance f11ffcda-8f26-4200-880f-c6fbf188e809 on hv-cinder-76015 Sep 15 04:23:30.721079 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-5f7426a9-3dbd-4a05-a180-ba6a010facd9 req-67a2215e-e2e3-41ed-b952-15f81366f2b6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043424 Sep 15 04:23:30.722095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 66/144] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:30.757230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:30.758290 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:30.770023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.773010 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.774298 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:30.775213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:30.871714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f11aa98a-b82a-4cc3-8e46-fb2ea90633a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.118912 Sep 15 04:23:30.872355 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 79/145] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:30 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:31.459594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:31.460564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:31.482845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.483336 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.484141 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.484579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.593682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-9f483891-3e5a-4f58-9915-3245830fc884 req-3c80eef7-d877-45e6-b106-e88cc50115bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c151704f-6c0f-42b5-94c6-d0065fa139d9", "tag": "37cbe769-3288-4aab-88e4-e055e2e30f6c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:31.595402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:31.595402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:31.627591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9f483891-3e5a-4f58-9915-3245830fc884 req-3c80eef7-d877-45e6-b106-e88cc50115bd service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.628043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9f483891-3e5a-4f58-9915-3245830fc884 req-3c80eef7-d877-45e6-b106-e88cc50115bd service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.646146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-9f483891-3e5a-4f58-9915-3245830fc884 req-3c80eef7-d877-45e6-b106-e88cc50115bd service nova] Creating event network-changed:37cbe769-3288-4aab-88e4-e055e2e30f6c for instance c151704f-6c0f-42b5-94c6-d0065fa139d9 on hv-cinder-76015 Sep 15 04:23:31.657804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-9f483891-3e5a-4f58-9915-3245830fc884 req-3c80eef7-d877-45e6-b106-e88cc50115bd service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069024 Sep 15 04:23:31.658852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 80/146] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:23:31.689273 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:31.699668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:31.700373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:31.707903 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0b42365c-e36a-4bc7-80fd-d9cfdbd903a5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.255294 Sep 15 04:23:31.712060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.712741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.712979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 67/147] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:31 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:31.713797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.714237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.724569 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:31.726037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:31.733469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] HTTP exception thrown: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. Sep 15 04:23:31.734291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Returning 404 to user: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:23:31.735209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8683d17b-b137-4a53-a782-d02ea3bb33bf tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 404 len: 111 microversion: 2.1 time: 0.046496 Sep 15 04:23:31.738861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 81/148] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:31 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:23:31.757358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.757842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.758675 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.759115 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.884311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:31.885403 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:31.894193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.895593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.896962 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.897547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.951432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:31.958723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-95d6c941-b442-49fa-ab97-4b771f4fc922 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.238226 Sep 15 04:23:31.959440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 68/149] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:31 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:31.964217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:31.965169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:31.971041 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.971529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.972852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:31.973289 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:31.986653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] HTTP exception thrown: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. Sep 15 04:23:31.987092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Returning 404 to user: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:23:31.989064 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1c767fdb-78eb-44e2-b8c1-1a558e9999f2 tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028132 Sep 15 04:23:31.991202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 69/150] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:23:31 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809/os-volume_attachments => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:23:32.008643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-735e5eae-ad7e-49a6-898d-7639716b24bc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.127648 Sep 15 04:23:32.009280 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 82/151] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:31 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:23:32.635114 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:32.636191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:32.644205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.644923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:32.645896 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.649175 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:32.727739 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:32.729210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:32.733463 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5e7a7aae-03fd-4ae9-990b-dca55e8804f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 0.102786 Sep 15 04:23:32.735261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 70/152] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:32 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:32.740901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.742687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:32.747096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.747941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:32.927564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:32.936616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a4fb9b97-3132-439c-a295-92e3fcbaf4f2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.213315 Sep 15 04:23:32.938147 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 83/153] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:32 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:32.978847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:32.980078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:32.992526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.993507 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:32.994926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:32.995954 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.019938 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:33.021141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:33.031422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.032119 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.033100 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.034500 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.166360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:33.174235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-866a7afc-232b-4429-b89a-0fdf7fe458c9 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.201993 Sep 15 04:23:33.174800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 71/154] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:32 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:33.263122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:33.263640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:33.271122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.271599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.272380 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.272816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.287111 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] HTTP exception thrown: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. Sep 15 04:23:33.288059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Returning 404 to user: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:23:33.292763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9f48f8e9-414a-432e-aaca-abafe77d849d tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 404 len: 111 microversion: 2.1 time: 0.029790 Sep 15 04:23:33.292763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 72/155] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:23:33 2021] DELETE /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:23:33.298879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:33.299742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] [instance: f11ffcda-8f26-4200-880f-c6fbf188e809] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:33.308006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.308972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.310153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.310582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.327001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] HTTP exception thrown: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. Sep 15 04:23:33.327939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] Returning 404 to user: Instance f11ffcda-8f26-4200-880f-c6fbf188e809 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:23:33.328917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c7edaedf-ea93-4387-94a0-b1fbba14cfac tempest-DeleteServersTestJSON-770277850 tempest-DeleteServersTestJSON-770277850-project] 10.222.0.37 "GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809" status: 404 len: 111 microversion: 2.1 time: 0.033866 Sep 15 04:23:33.329617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 73/156] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:33 2021] GET /compute/v2.1/servers/f11ffcda-8f26-4200-880f-c6fbf188e809 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:23:33.718650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-dea414a3-e65e-47a8-a55f-c03b7b1972bd req-1ab0fd12-cf0e-4342-955e-246c0c980a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:33.720171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:33.720171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:23:33.728353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-dea414a3-e65e-47a8-a55f-c03b7b1972bd req-1ab0fd12-cf0e-4342-955e-246c0c980a69 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.729049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-dea414a3-e65e-47a8-a55f-c03b7b1972bd req-1ab0fd12-cf0e-4342-955e-246c0c980a69 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.744786 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-dea414a3-e65e-47a8-a55f-c03b7b1972bd req-1ab0fd12-cf0e-4342-955e-246c0c980a69 service nova] Creating event network-changed:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:23:33.750918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-dea414a3-e65e-47a8-a55f-c03b7b1972bd req-1ab0fd12-cf0e-4342-955e-246c0c980a69 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035794 Sep 15 04:23:33.751670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 74/157] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:23:33.756807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:33.757857 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:33.764270 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.764794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:33.765652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:33.766156 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:35.809687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0e494c5f-8898-41cf-a4fb-482fe01fb703 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 2.793826 Sep 15 04:23:35.810822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 84/158] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:33 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 2796 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:23:35.811873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c6bb8b0f-787c-46fe-bb4e-b4377846128f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 2.058726 Sep 15 04:23:35.813163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 75/159] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:33 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:35.817927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:35.819101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:35.819863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:35.820454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:35.827721 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:35.828370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:35.834327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:35.835049 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:35.836742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:35.837192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:35.838373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:35.838959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:36.165155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:36.170910 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-65fbe2fd-5278-45d0-b5e9-845adf938217 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.356356 Sep 15 04:23:36.172174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 76/160] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:35 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:36.202875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:36.210676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bc57cc14-a1bc-4693-bd53-0406509483e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.398399 Sep 15 04:23:36.211356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 85/161] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:35 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:36.822932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:36.824184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:36.825116 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:36.827470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:36.831769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:36.832374 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:36.833150 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:36.836604 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:36.836969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:36.839416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:36.840435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:36.841075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:39.138458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-864038b5-6088-48a7-baf5-f19f5a0efb52 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 2.320952 Sep 15 04:23:39.141834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 77/162] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:36 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:39.144630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:39.145324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:39.151475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:39.151912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:39.152684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:39.153279 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:39.157056 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-aed400e7-e7f7-4585-9b6b-d8f59c1e4984 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 2.337679 Sep 15 04:23:39.158267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 86/163] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:36 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 2340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:39.165357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:39.166062 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:39.177553 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:39.181047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:39.181885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:39.187538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:39.438990 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:39.449665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-52c223c3-de25-403b-890e-beec6f3c5b82 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.309000 Sep 15 04:23:39.450592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 78/164] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:39 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:39.483095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:39.492202 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-64f86716-9e05-4617-a648-8006b3c9acd9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.331835 Sep 15 04:23:39.492823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 87/165] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:39 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:40.149516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:40.150544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:40.156670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.157116 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.157875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.158510 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.172241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:40.173495 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:40.181221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.182028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.183247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.183888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.233254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d32e5bd4-ed84-4da1-8086-d957ed1b16b7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.087120 Sep 15 04:23:40.233984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 79/166] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:40 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:40.259296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ab20bce9-f20f-49b9-b684-39a047cf8828 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 0.092719 Sep 15 04:23:40.260192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 88/167] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:40 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:40.472384 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:40.473596 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:40.481247 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.482203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.483473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.484338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.510534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:40.511448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:40.519922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.520742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.521744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:40.522320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:40.732315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:40.740504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6383cf7d-399e-425b-8b8f-5ef40b1e9ef7 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.276000 Sep 15 04:23:40.740979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 80/168] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:40 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:40.750164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:40.759356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d97227f0-464f-4020-a8a4-fb44e26441d4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.253638 Sep 15 04:23:40.759928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 89/169] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:40 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:41.244539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:41.246860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:41.258918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.259409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.260251 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.260686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.270905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:41.272066 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:41.278928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.279523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.280531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.281201 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.356277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-95ccaf97-fc10-4658-b08b-f265244d4d8f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 14 microversion: 2.1 time: 0.115526 Sep 15 04:23:41.357052 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 81/170] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:41 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:23:41.361016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-85ec8050-20f8-42e7-a607-93b6ac022681 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 0.094137 Sep 15 04:23:41.361642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 90/171] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:41 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:41.762023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:41.763213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:41.778117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.778419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:41.780167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:41.780467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.781595 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.782248 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.794967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.795484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:41.796295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:41.797046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:42.060052 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:42.075028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8d20af38-278d-4359-8d63-a4f1ad3d874c tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.319365 Sep 15 04:23:42.076330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 82/172] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:41 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:42.158065 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:42.166584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ec873644-7d73-434d-bac4-e0a5ac1f6a06 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.392906 Sep 15 04:23:42.167176 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 91/173] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:41 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:42.369008 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:42.370139 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:42.372815 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:42.373809 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:42.380528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:42.380983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:42.381344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:42.381780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:42.381883 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:42.382219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:42.382559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:42.382995 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:42.507696 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0d0889d8-04b0-4e52-8bc0-dfe34219cc9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 6451 microversion: 2.1 time: 0.142106 Sep 15 04:23:42.508611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 83/174] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:42 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:42.509377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bb0194dc-1332-4396-84c4-3771a6679585 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 14 microversion: 2.20 time: 0.140118 Sep 15 04:23:42.515028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 92/175] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:42 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:43.093131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:43.099316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:43.102490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.103183 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.104359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.105117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.188584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:43.189419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:43.202987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.203588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.204503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.205112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.247377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:43.256340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-89a45666-5026-4c79-806f-7454b01800ea tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.167149 Sep 15 04:23:43.257626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 84/176] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:43 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:43.363391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:43.370915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-efeb37f1-c3b2-4154-8a04-e77dd260857e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.190436 Sep 15 04:23:43.371515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 93/177] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:43 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:43.525901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:43.526878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:43.530078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:43.541315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:43.543578 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.544990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.546638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.547688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.557340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.558447 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.559924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:43.561467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:43.660012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-58f0264d-c2bb-42dc-958f-6b3eeac9d0d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 487 microversion: 2.20 time: 0.139916 Sep 15 04:23:43.664145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 94/178] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:43 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 487 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:43.695143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-54ba2d97-0ca4-4602-bbc2-721d1c57e003 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 11371 microversion: 2.1 time: 0.176929 Sep 15 04:23:43.695843 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 85/179] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:43 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 11371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:23:44.011827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-5e80d2e0-1080-4a67-9a9b-afefbc1adc86 req-be10e9a2-1139-4e4a-bd7b-2b5c1a1a8ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c151704f-6c0f-42b5-94c6-d0065fa139d9", "name": "network-vif-plugged", "status": "completed", "tag": "37cbe769-3288-4aab-88e4-e055e2e30f6c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:44.013295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:44.013295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:44.021308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5e80d2e0-1080-4a67-9a9b-afefbc1adc86 req-be10e9a2-1139-4e4a-bd7b-2b5c1a1a8ed2 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.022000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5e80d2e0-1080-4a67-9a9b-afefbc1adc86 req-be10e9a2-1139-4e4a-bd7b-2b5c1a1a8ed2 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.033679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-5e80d2e0-1080-4a67-9a9b-afefbc1adc86 req-be10e9a2-1139-4e4a-bd7b-2b5c1a1a8ed2 service nova] Creating event network-vif-plugged:37cbe769-3288-4aab-88e4-e055e2e30f6c for instance c151704f-6c0f-42b5-94c6-d0065fa139d9 on hv-cinder-76015 Sep 15 04:23:44.038566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-5e80d2e0-1080-4a67-9a9b-afefbc1adc86 req-be10e9a2-1139-4e4a-bd7b-2b5c1a1a8ed2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030652 Sep 15 04:23:44.039169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 95/180] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:44.273653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:44.274349 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:44.280897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.281344 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.282109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.282548 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.387994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:44.388690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:44.394607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.395051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.395835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.396267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.411815 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:44.419395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d9d0db68-6820-4160-adc8-749a8706e912 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.149743 Sep 15 04:23:44.419971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 86/181] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:44 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:44.517044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:44.525097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2953e225-ff20-493c-a374-4389356dc7d6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.141005 Sep 15 04:23:44.525601 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 96/182] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:44 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:44.670581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:44.671514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:44.678110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.678554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.679346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.679779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.705643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:44.706705 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:44.712560 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.713016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:44.713793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:44.714218 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:46.955383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ed5e541d-6a76-4a50-ac71-5b4ecf6df6a4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 15025 microversion: 2.20 time: 2.288206 Sep 15 04:23:46.957028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 87/183] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:44 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 15025 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:46.962421 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:46.963285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:46.969521 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-38a3a547-ad66-402c-b79b-97088c1868c5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 17861 microversion: 2.1 time: 2.267344 Sep 15 04:23:46.970006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:46.970138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 97/184] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:44 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 17861 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:46.970284 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:46.973996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:46.974451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:46.976116 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:46.977112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:46.983522 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:46.983972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:46.984809 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:46.985327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:47.219050 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:47.227625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-54e6765d-de6d-46ac-a220-126864f821fd tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.269153 Sep 15 04:23:47.228348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 88/185] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:46 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:47.237617 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:47.244807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7183a60c-328d-43b6-b6cf-eebea49f3504 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.273273 Sep 15 04:23:47.245358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 98/186] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:46 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:47.967149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:47.968072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:47.974406 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:47.974988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:47.976130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:47.976581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:47.980491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:47.981387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:47.988388 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:47.988831 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:47.989597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:47.990019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:48.061908 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4407310e-0268-4389-b149-5760ebb45a47 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 17861 microversion: 2.20 time: 0.098168 Sep 15 04:23:48.067508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 89/187] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:47 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 17861 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:48.076624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-89674dd1-5539-478a-aba2-c2a6be8106e9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 18356 microversion: 2.1 time: 0.099456 Sep 15 04:23:48.077263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 99/188] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:47 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 18356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:48.244517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:48.246283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:48.253379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:48.254103 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:48.256894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:48.257583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:48.263527 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:48.264519 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:48.271425 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:48.271885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:48.273262 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:48.273767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:48.666075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:48.673869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:48.674147 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-00108808-6c86-45ff-8db1-0a2595a31c04 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1314 microversion: 2.1 time: 0.434306 Sep 15 04:23:48.675334 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 90/189] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:48 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:48.682951 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3775bb2d-0d21-4b06-b8c4-f96cc057df70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.425107 Sep 15 04:23:48.683551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 100/190] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:48 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:49.074424 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:49.075391 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:49.081208 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:49.081642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:49.082751 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:49.083214 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:49.087342 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:49.088242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:49.093895 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:49.094341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:49.095180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:49.095617 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.603727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-73ffc7d5-231c-409c-997f-b061147d6b25 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 21935 microversion: 2.20 time: 2.532810 Sep 15 04:23:51.606822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 91/191] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:49 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 21935 bytes in 2534 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:51.609554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:51.610253 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:51.617159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.617626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.618088 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b465195d-bd6c-42c4-9131-a8c98bbb5af8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 24011 microversion: 2.1 time: 2.534159 Sep 15 04:23:51.618534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.618842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.619104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 101/192] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:49 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 24011 bytes in 2536 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:51.624003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:51.624699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:51.633162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.633972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.635383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.636181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.801507 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:51.808490 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:51.808948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f68010e5-fb9a-42d9-b61a-85398d461051 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1463 microversion: 2.1 time: 0.203255 Sep 15 04:23:51.809513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 92/193] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:51 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:51.817482 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-93329976-5adc-4b55-b1e7-ff7740a12904 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.197190 Sep 15 04:23:51.818038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 102/194] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:51 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:51.848375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:51.848865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:51.855325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.855713 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.856474 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.856905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.881591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:23:51.957613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bcd5c55d-e709-47e1-af6a-c1cc943de8e4 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "DELETE /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 204 len: 0 microversion: 2.1 time: 0.113106 Sep 15 04:23:51.958201 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 93/195] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:23:51 2021] DELETE /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:23:51.967153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:51.967758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:51.974251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.974728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:51.975551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:51.976031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.098025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:52.106216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-95e41f94-ad6a-4156-95c9-4d84281bdc7a tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1469 microversion: 2.1 time: 0.143080 Sep 15 04:23:52.106731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 103/196] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:51 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1469 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:52.615933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:52.617082 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:52.623504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.623952 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.625388 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.625962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.631773 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:52.633637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:52.641516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.642169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.644406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.644406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.732321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f16b6834-adaf-4787-b6b7-bf92c08d0fcc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 23226 microversion: 2.20 time: 0.120820 Sep 15 04:23:52.733264 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 94/197] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:52 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 23226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:23:52.747601 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b584de34-9398-4162-b295-60af19d071fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 25217 microversion: 2.1 time: 0.122208 Sep 15 04:23:52.748593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 104/198] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:52 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 25217 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:52.836180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:52.836847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:52.843261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.843949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.845275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:52.845575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:52.978703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:52.986243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ae25de5f-ec25-4e2b-9790-bc1a8f8033d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.155041 Sep 15 04:23:52.987521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 95/199] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:52 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:53.124383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:53.125077 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:53.132287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.132740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.133820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.134232 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.256120 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:53.263707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-dee99760-615a-4a61-a6c1-72511cee385d tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1469 microversion: 2.1 time: 0.143319 Sep 15 04:23:53.264271 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 105/200] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:53 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1469 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:53.744400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:53.746378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:53.752511 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.753109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.753969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.754646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.761115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:53.762713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:53.770967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.771639 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.773234 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:53.773924 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:53.843091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9e64a44d-597b-49b8-87d2-9d8f37d9a990 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 24082 microversion: 2.20 time: 0.102325 Sep 15 04:23:53.843903 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 96/201] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:53 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 24082 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:53.867986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ee66fa54-fae3-4597-8cb6-4b15ea38ca30 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 26016 microversion: 2.1 time: 0.112164 Sep 15 04:23:53.878870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 106/202] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:53 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 26016 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:54.004487 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:54.005180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:54.014845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.015351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.016333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.016932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.281411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:54.282150 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:54.293048 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.293504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.294286 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.294718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.381714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c1aa812b60f4f72bff98903e022d254', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '432c32a8889b45fbbbc84311cedc9b15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:54.395449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cb704dee-3c9d-429d-84f3-ed99f77fbd7f tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 200 len: 1427 microversion: 2.1 time: 0.118114 Sep 15 04:23:54.396080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 107/203] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:54 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 1427 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:23:54.397290 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:54.406504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ac123c1f-bbc8-4dfa-b9dc-78c60f87bb23 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.405679 Sep 15 04:23:54.408135 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 97/204] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:53 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:54.409354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-e00a7c20-5dea-488a-9c16-836e6ffd3032 req-08456474-fc88-48b0-9eca-bfdb695ef2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c151704f-6c0f-42b5-94c6-d0065fa139d9", "name": "network-vif-deleted", "tag": "37cbe769-3288-4aab-88e4-e055e2e30f6c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:54.411211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:23:54.411211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:23:54.433108 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e00a7c20-5dea-488a-9c16-836e6ffd3032 req-08456474-fc88-48b0-9eca-bfdb695ef2b5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.433585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e00a7c20-5dea-488a-9c16-836e6ffd3032 req-08456474-fc88-48b0-9eca-bfdb695ef2b5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.446336 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-e00a7c20-5dea-488a-9c16-836e6ffd3032 req-08456474-fc88-48b0-9eca-bfdb695ef2b5 service nova] Creating event network-vif-deleted:37cbe769-3288-4aab-88e4-e055e2e30f6c for instance c151704f-6c0f-42b5-94c6-d0065fa139d9 on hv-cinder-76015 Sep 15 04:23:54.451874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-e00a7c20-5dea-488a-9c16-836e6ffd3032 req-08456474-fc88-48b0-9eca-bfdb695ef2b5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054658 Sep 15 04:23:54.453814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 108/205] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:23:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:23:54.854762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:54.855701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:54.862550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.863010 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.863822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.864261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.884741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:54.885789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:54.891856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.892324 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.893977 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:54.894471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:54.954976 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a68eb1ec-785b-4e97-b865-376dbc256475 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 25036 microversion: 2.20 time: 0.103695 Sep 15 04:23:54.957026 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 98/206] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:54 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 25036 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:54.996173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a2ea20bd-a034-4266-bd06-476b1b43f265 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 26773 microversion: 2.1 time: 0.115223 Sep 15 04:23:54.996979 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 109/207] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:54 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 26773 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:55.413218 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:55.417308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] [instance: c151704f-6c0f-42b5-94c6-d0065fa139d9] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:55.425153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.425153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:55.426235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.426923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:55.428943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:55.429732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:55.436047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.436632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:55.443993 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] HTTP exception thrown: Instance c151704f-6c0f-42b5-94c6-d0065fa139d9 could not be found. Sep 15 04:23:55.444263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.444576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:55.444909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] Returning 404 to user: Instance c151704f-6c0f-42b5-94c6-d0065fa139d9 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:23:55.445965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-67f48d0f-938b-497c-9304-88e444983b14 tempest-VolumesNegativeTest-1648884527 tempest-VolumesNegativeTest-1648884527-project] 10.222.0.37 "GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9" status: 404 len: 111 microversion: 2.1 time: 0.037245 Sep 15 04:23:55.450289 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 99/208] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:55 2021] GET /compute/v2.1/servers/c151704f-6c0f-42b5-94c6-d0065fa139d9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:23:55.598475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:55.607466 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2e5cc005-04cc-417a-93eb-fe467d62cb8a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.184135 Sep 15 04:23:55.608242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 110/209] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:55 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:55.969984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:55.970848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:55.988131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.988598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:55.989478 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:55.989922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:56.015822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:56.017683 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:56.036243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:56.036810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:56.043359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:56.043359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:56.085630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9a808e08-57d3-45ae-8590-fdfca26a7fb4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 26165 microversion: 2.20 time: 0.119490 Sep 15 04:23:56.086261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 100/210] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:55 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 26165 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:56.134402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b0ed5da1-ad25-4641-8405-562256780a05 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 27392 microversion: 2.1 time: 0.128954 Sep 15 04:23:56.135099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 111/211] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:56 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 27392 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:23:56.625145 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:56.626161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:56.632780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:56.633718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:56.634725 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:56.635281 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:56.774811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:56.782780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2901f37f-2b76-4e7b-bcbb-c1f587dc935b tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.161908 Sep 15 04:23:56.783516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 101/212] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:56 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:57.099843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:57.100869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:57.134209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.134792 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.135789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.136367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.147875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:57.148780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:57.155661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.156317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.157278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.157889 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.239281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ebd659ca-2d20-4166-8fba-eac945aa89c7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 26949 microversion: 2.20 time: 0.144285 Sep 15 04:23:57.243177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 112/213] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:57 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 26949 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:57.274090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f2b4967a-8d70-4519-9e44-d1897dc96389 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 27701 microversion: 2.1 time: 0.129701 Sep 15 04:23:57.275801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 102/214] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:57 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 27701 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:23:57.804211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:57.805151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:57.811867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.812575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.813469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:57.814136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:57.965790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:57.973685 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ca5d7fec-571f-4bef-8348-1a058f97a9e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.173441 Sep 15 04:23:57.974401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 113/215] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:57 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:58.251885 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:58.253739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:58.265593 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:58.266510 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:58.268951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:58.269752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:58.286473 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:58.287602 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:58.293715 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:58.295339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:58.298641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:58.299185 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:58.376934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-19f3d450-eb51-4212-a92b-2a5602f46ddc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 27428 microversion: 2.20 time: 0.128853 Sep 15 04:23:58.379362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 103/216] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:58 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 27428 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:58.405405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-70026b30-93d6-45b3-a703-1ef84cd4f208 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 27994 microversion: 2.1 time: 0.122005 Sep 15 04:23:58.405405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 114/217] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:58 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 27994 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:23:58.995071 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:23:58.995942 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:59.009911 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.010456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.011378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.011885 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.145359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:23:59.153691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-32a66001-50d7-49d8-911b-2b6bfadcbf1f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.166784 Sep 15 04:23:59.154272 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 104/218] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:23:58 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:23:59.389735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:59.391671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:59.399281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.399728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.400499 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.400937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.419839 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:23:59.420833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:23:59.430049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.430506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.431327 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:23:59.431775 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:23:59.511210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d0fa0c0d-2240-4c45-9232-f4248c5775b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 27685 microversion: 2.20 time: 0.125483 Sep 15 04:23:59.515082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 115/219] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:23:59 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 27685 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:23:59.548860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4485a752-47d1-43fa-9a35-4f99cc4e2737 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28183 microversion: 2.1 time: 0.135350 Sep 15 04:23:59.551275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 105/220] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:23:59 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:00.173044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:00.174020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:00.181414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.182153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.183370 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.184222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.322583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:00.331157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-04ef9371-518a-430b-86b8-e88760afd9d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.162033 Sep 15 04:24:00.331738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 116/221] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:00 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:00.524849 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:00.525988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:00.535088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.535785 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.536780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.537219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.561895 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:00.567801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:00.577128 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.580096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.585431 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:00.586172 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:00.649918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8f80e2a6-2332-437f-a58a-9368b28e3200 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28098 microversion: 2.20 time: 0.129851 Sep 15 04:24:00.650650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 106/222] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:00 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28098 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:00.684305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c6a815db-51bc-450b-b125-f985ebcea049 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28183 microversion: 2.1 time: 0.125900 Sep 15 04:24:00.685012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 117/223] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:00 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:01.348860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:01.349572 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:01.359937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.360681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.362956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.363747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.511455 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:01.519700 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c8601e63-5c3c-4f32-86b4-129ec14613e6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.174942 Sep 15 04:24:01.520271 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 107/224] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:01 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:01.662888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:01.664581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:01.671220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.672038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.673001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.673628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.696992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:01.698350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:01.706930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.707764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.708805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:01.709524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:01.781631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-95c5517b-65b6-407d-9a92-52bab865d60b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28165 microversion: 2.20 time: 0.123484 Sep 15 04:24:01.782382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 118/225] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:01 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28165 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:01.818533 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-833c4865-23fc-4ba1-b943-b49e69e7c633 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28473 microversion: 2.1 time: 0.125529 Sep 15 04:24:01.819340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 108/226] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:01 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28473 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:02.538207 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:02.539284 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:02.546108 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.546571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.547361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.547797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.689333 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:02.699637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-361862d3-d172-40c1-9b0c-b9855091533d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.165328 Sep 15 04:24:02.700435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 119/227] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:02 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:02.795160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:02.796434 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:02.805373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.805859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.806762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.807256 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.832947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:02.834654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:02.842506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.843550 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.844746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:02.845228 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:02.890491 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d485ce5b-5e81-42b2-9919-8b285d08ecdd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28197 microversion: 2.20 time: 0.099568 Sep 15 04:24:02.891793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 109/228] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:02 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:02.928291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8f300e13-bb34-4798-b4e4-95b2ace92274 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28473 microversion: 2.1 time: 0.100358 Sep 15 04:24:02.928985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 120/229] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:02 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28473 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:03.721022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:03.721022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:03.730666 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.731362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:03.732280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.732981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:03.862045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:03.869488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-97e12b2d-a1e7-4a36-879b-9b7e2df42811 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.155675 Sep 15 04:24:03.870045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 110/230] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:03 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:03.903030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:03.904119 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:03.911052 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.911527 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:03.912294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.912732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:03.944467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:03.945384 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:03.951270 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.951758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:03.952531 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:03.952973 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:06.913348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4f9c0847-ce7c-4279-b275-756601b7b3ba tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28456 microversion: 2.20 time: 3.014158 Sep 15 04:24:06.917337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 121/231] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:03 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28456 bytes in 3016 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:06.919046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:06.919784 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:06.926765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:06.927241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:06.928011 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:06.928446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:06.942874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8e7be41e-0e96-44b8-8687-f312d0c7e001 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 3.004329 Sep 15 04:24:06.944008 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 111/232] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:03 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 3007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:07.058595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:07.066993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6e99e437-6e6d-45f0-96e2-6ab931e064d3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1522 microversion: 2.1 time: 0.151513 Sep 15 04:24:07.067546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 122/233] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:06 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:07.926245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:07.927185 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:07.933561 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:07.934003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:07.934753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:07.935205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:07.954642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:07.956998 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:07.962948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:07.963459 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:07.964339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:07.964775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:10.216769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-22c110c9-c4ff-4426-aafb-58d4dbd8e642 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 2.295104 Sep 15 04:24:10.221420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 112/234] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:07 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:10.222794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:10.223515 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:10.226872 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-54a6134d-5a02-432b-8c89-3d93afb5c4cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 2.275024 Sep 15 04:24:10.227626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 123/235] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:07 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:10.230362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:10.230842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:10.231607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:10.232038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:10.351878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:10.359013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-dc623c6c-d588-4e72-8185-1c38f5d61157 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1502 microversion: 2.1 time: 0.140358 Sep 15 04:24:10.359589 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 113/236] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:10 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1502 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:10.374758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:10.375479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:10.381853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:10.382296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:10.383047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:10.383504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:10.505741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:10.512972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5d99a719-7ef2-4b10-b0fc-8bd65fd656d5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1516 microversion: 2.1 time: 0.142103 Sep 15 04:24:10.513563 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 124/237] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:10 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1516 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:11.231731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:11.231731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:11.236775 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:11.237226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:11.237744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:11.238151 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:11.238432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:11.238736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:11.244685 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:11.245160 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:11.245954 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:11.246391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:13.397636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bc2db186-e429-401b-b65b-d0197bcdb66f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 2.172171 Sep 15 04:24:13.398739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 114/238] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:11 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:13.418842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8ef7ef37-31e8-40f1-9031-e9d5d65d3fd0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 2.184772 Sep 15 04:24:13.419514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 125/239] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:11 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:14.411350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:14.412406 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:14.421633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:14.422632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:14.431890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:14.432884 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:14.436852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:14.437897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:14.445273 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:14.445982 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:14.446897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:14.447375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:14.525044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-30805b49-c69d-4dc4-9ffb-1c3b739d0f2c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.096882 Sep 15 04:24:14.525696 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 126/240] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:14 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:14.536305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-569251cb-a772-44c4-89c6-b288f1343e74 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 0.130365 Sep 15 04:24:14.540130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 115/241] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:14 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:15.021552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:15.022706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:15.028829 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.029286 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.030089 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.030526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.053560 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lazy-loading 'flavor' on Instance uuid 76d0ff04-6f6c-469a-b96d-0a01ba58779e {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:24:15.134472 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1ba71e57-6be0-49d3-92d2-dae41640d9ac tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action" status: 200 len: 32 microversion: 2.1 time: 0.116975 Sep 15 04:24:15.135469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 127/242] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:15 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action => generated 32 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:24:15.146482 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:15.147065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:15.190606 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.190943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.194889 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.199327 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.537800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:15.538810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:15.557244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.557901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.558699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.559143 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.602636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:15.621206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-079a768e-f49f-4e6d-9cea-d943c659b705 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.478023 Sep 15 04:24:15.621985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 116/243] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:15 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:15.649897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:15.652911 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:15.653445 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7b300016-f59f-435f-96a7-262f79bc9dbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.119990 Sep 15 04:24:15.658688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 128/244] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:15 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:15.665860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.667677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.670635 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:15.672431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:15.766724 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4617436f-b68a-438e-93a8-837412753173 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 0.128062 Sep 15 04:24:15.768037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 117/245] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:15 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:16.650864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:16.651787 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:16.660672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.660672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.660672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.661420 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.667632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:16.668988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:16.679164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.679629 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.680429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.680875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.783904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1023ef1e-c2a0-459c-bc4f-81a99615f833 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.120420 Sep 15 04:24:16.788001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 118/246] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:16 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:16.792694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:16.796473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:16.807037 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.807521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.811170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:16.811633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:16.821839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:16.831426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ea9cca47-1c3b-44d1-ba30-17b91480f614 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.183341 Sep 15 04:24:16.832632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 129/247] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:16 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:16.914105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9d307928-8d2c-4d6a-bf81-1724244da56b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 0.127908 Sep 15 04:24:16.915195 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 119/248] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:16 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:17.795742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:17.797253 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:17.804566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:17.805214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:17.806252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:17.806849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:17.850915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:17.851670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:17.858767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:17.859204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:17.860014 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:17.860442 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:18.026475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:18.036137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1bc39c8c-5d59-45b1-9746-ab10040dd4d7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.190166 Sep 15 04:24:18.036902 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 120/249] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:17 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:18.042253 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:18.043240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:18.051094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:18.054109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:18.054979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:18.055663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:20.171852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-995cc959-ee47-4ac9-a14a-5f465eb1b444 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 2.132993 Sep 15 04:24:20.172765 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 121/250] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:18 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:20.178340 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-15926eea-a421-430c-8fb2-05dd10f049ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 2.385832 Sep 15 04:24:20.179007 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:20.179212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 130/251] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:17 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 2388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:20.180310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:20.188409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:20.191508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:20.192592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:20.193438 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:20.331685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:20.339631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ffc84ab2-f265-41f3-9fd9-3358edc3a8cd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.164775 Sep 15 04:24:20.341341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 122/252] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:20 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:21.186011 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:21.196892 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:21.196998 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:21.196998 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:21.197717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.198141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.198252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.198962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.200740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.202328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.204348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.207757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.304395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c70d7c7e-66a6-405d-a7eb-dc69750d1bf9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.118276 Sep 15 04:24:21.307320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 123/253] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:21 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:24:21.311905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-63e27338-d3cb-438c-8462-8788ad678373 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 0.129946 Sep 15 04:24:21.312823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 131/254] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:21 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:21.366139 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:21.366842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:21.386932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.387350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.388145 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:21.388585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:21.717895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:21.729301 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2af3bc5e-ec5a-4afb-b2b4-57516b576950 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.374044 Sep 15 04:24:21.743903 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 124/255] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:21 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:22.317614 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:22.318610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:22.325437 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.325737 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:22.326232 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.326676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.326787 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:22.327110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.336342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.336770 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.337658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.338130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.405291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-360f962e-3373-47ae-897c-eb7770ce4305 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.091660 Sep 15 04:24:22.407199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 132/256] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:22 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:22.423355 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-722fea3c-2432-4ca2-bb7f-39f786e7357a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28623 microversion: 2.20 time: 0.102116 Sep 15 04:24:22.424088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 125/257] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:22 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28623 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:24:22.749917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:22.750669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:22.757915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.758555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.759555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:22.760265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:22.997155 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:23.009764 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-44fe26e7-82be-4aa4-bf17-10c9a9470dbf tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.265256 Sep 15 04:24:23.010558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 133/258] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:22 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:23.421366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:23.422926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:23.450243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:23.451970 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:23.461462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:23.463182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:23.465068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:23.466655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:23.467092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:23.468826 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:23.472027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:23.472785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:23.559186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-26657e1a-33cf-4b0a-b89f-f5ab4ddd4b09 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 28640 microversion: 2.1 time: 0.143843 Sep 15 04:24:23.559832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 126/259] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:23 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 28640 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:23.591670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c7135e05-e153-4cd1-8a84-68446eb30b03 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 28638 microversion: 2.20 time: 0.159996 Sep 15 04:24:23.592571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 134/260] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:23 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 28638 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:24:24.028077 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:24.029540 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:24.038033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.038858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.039879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.040521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.321091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:24.331749 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6ec88563-6102-42ba-adf3-372f820d5820 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.307406 Sep 15 04:24:24.332457 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 127/261] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:24 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:24.574976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:24.576746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:24.585822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.586534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.587501 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.588153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.608721 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:24.614148 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:24.625057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.626022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.627378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:24.628053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:24.718391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-06cb66fa-419d-4e63-a3b7-3fa0a8ea82b5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 29097 microversion: 2.1 time: 0.148543 Sep 15 04:24:24.724960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 135/262] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:24 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 29097 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:24.744644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7ba90bb0-7102-4ba5-92e1-e55b786e48fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 29680 microversion: 2.20 time: 0.143988 Sep 15 04:24:24.746671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 128/263] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:24 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 29680 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:25.352188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:25.355224 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:25.393344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.394062 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.395014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.395662 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.722112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:25.734031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:25.735725 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:25.747412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9ed02a3e-888f-46d9-80b5-47d81f117d19 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.400904 Sep 15 04:24:25.754659 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.755915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 136/264] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:25 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:25.758015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.759239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.759934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.772851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:25.778768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:25.795167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.796138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.798824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:25.802004 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:25.921296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-411be376-0301-4bf2-b3f6-e87731bf282c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 30189 microversion: 2.1 time: 0.191242 Sep 15 04:24:25.923219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 129/265] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:25 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 30189 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:25.964191 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f2703a89-675b-4660-ae1e-b2c78481507c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 30739 microversion: 2.20 time: 0.206505 Sep 15 04:24:25.965308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 137/266] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:25 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 30739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:26.773537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:26.774918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:26.784017 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:26.784436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:26.793343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:26.794967 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:26.933067 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:26.935516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:26.951488 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:26.952233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:26.953196 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:26.953799 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:27.096262 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c185b42d-4d17-4991-8681-9787444097ac tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 31329 microversion: 2.1 time: 0.165100 Sep 15 04:24:27.097314 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 138/267] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:26 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 31329 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:27.102818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:27.121798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:27.146082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:27.148603 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:27.150869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:27.154898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:27.270022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3962f412-489d-43d5-82c5-1c9d4554d698 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 32486 microversion: 2.20 time: 0.170851 Sep 15 04:24:27.271532 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 139/268] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:27 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 32486 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:27.360358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:27.412307 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0b97ee94-38aa-4d6e-93bc-74ca4d4ff0ba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.642651 Sep 15 04:24:27.415918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 130/269] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:26 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:28.108506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:28.109520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:28.124379 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.124754 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.125551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.125987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.283762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:28.284803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:28.298246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.300370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.302370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.308865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.317218 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-154dff50-62a7-42e9-bc5c-13b1d2dbbff0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 32248 microversion: 2.1 time: 0.212703 Sep 15 04:24:28.322966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 140/270] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:28 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 32248 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:28.432410 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3eb979cf-fb99-4267-976e-4fd3cb20a920 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 33299 microversion: 2.20 time: 0.153947 Sep 15 04:24:28.434516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 131/271] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:28 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 33299 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:28.441233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:28.443094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:28.453847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.454096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.455590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:28.456360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:28.778631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:28.798824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3a77f223-7f95-43dc-87d8-ed37020003bc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.365467 Sep 15 04:24:28.803753 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 141/272] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:28 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:29.330669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:29.331843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:29.344610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.345596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.348571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.349012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.486694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3f16f4e9-4c53-4fcd-a510-315bddd96f34 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 33019 microversion: 2.1 time: 0.159938 Sep 15 04:24:29.488248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 142/273] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:29 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 33019 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:29.498707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:29.506864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:29.522034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.522834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.528499 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.529707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.588649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Action: 'create', calling method: .version_select at 0x7f02a2c37430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-460250898"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:29.626071 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:24:29.636230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-872281b9-24c8-4681-bb98-7dda818821cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 33760 microversion: 2.20 time: 0.146268 Sep 15 04:24:29.637164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 143/274] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:29 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 33760 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:29.640671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for user fc599faf327249919f8dc76e65061ae3 and project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:24:29.821103 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:29.821811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:29.845391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.846211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.847222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:29.847819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:29.883100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:24:29.889973 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for user fc599faf327249919f8dc76e65061ae3 and project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:24:29.906110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9658cc53-de3b-409d-b282-7ff9f60be503 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.641721 Sep 15 04:24:29.906848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 132/275] 10.222.0.37 () {60 vars in 1158 bytes} [Wed Sep 15 04:24:29 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:30.029869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:30.039647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fc6bcd2b-b2b1-47c5-98fb-d6702f7281df tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.222860 Sep 15 04:24:30.041283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 144/276] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:29 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:30.503288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:30.504538 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:30.513567 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:30.514429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:30.515717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:30.516191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:30.623539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-323b8982-89ad-4376-a228-942a4222d9ec tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 33474 microversion: 2.1 time: 0.124612 Sep 15 04:24:30.624997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 133/277] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:30 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 33474 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:30.648730 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:30.649853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:30.656111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:30.662726 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:30.663754 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:30.664388 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:30.751008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e1bb9d61-7ee8-48b0-85e9-733a31985e7a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 34411 microversion: 2.20 time: 0.105594 Sep 15 04:24:30.752376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 145/278] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:30 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 34411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:31.059310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:31.060246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:31.068875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.069941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.071120 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.072070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.250892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:31.265350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0974d5b6-e648-413f-942a-4bdf6d72adba tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.210978 Sep 15 04:24:31.266319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 134/279] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:31 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:31.636228 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:31.637761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:31.648476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.649037 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.649949 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.650781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.763390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3042a4bb-b246-46e6-8799-3946d014dfbf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 34057 microversion: 2.1 time: 0.131148 Sep 15 04:24:31.764126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 146/280] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:31 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 34057 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:31.765832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:31.767830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:31.778978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.780190 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.781174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:31.782203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:31.871628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2258ceeb-5b59-4435-8baf-9d64089e7b89 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 35193 microversion: 2.20 time: 0.110890 Sep 15 04:24:31.873409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 135/281] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:31 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 35193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:24:32.285222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:32.285926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:32.292804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.293255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.294034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.294648 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.557047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:32.566540 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d94c36d9-d47a-49fc-a501-f48e52f21e93 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.285828 Sep 15 04:24:32.567596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 147/282] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:32 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:32.779441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:32.781369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:32.802581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.803389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.804975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.805590 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.885054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:32.895576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:32.898306 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d212492c-2a8f-429e-b9b4-30042cdc0ee4 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 34815 microversion: 2.1 time: 0.122896 Sep 15 04:24:32.899496 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 136/283] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:32 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 34815 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:32.903963 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.905762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.907450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:32.908402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:32.991302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-dfb7818d-57e2-4006-bfcf-61ba40fa6bf6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 36318 microversion: 2.20 time: 0.111207 Sep 15 04:24:32.995246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 148/284] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:32 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 36318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:33.591646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:33.592621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:33.605659 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:33.606665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:33.610977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:33.616569 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:33.787284 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:33.795425 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-32d65b1f-1e0e-4e3b-a56c-f6645f090234 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.210288 Sep 15 04:24:33.796049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 137/285] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:33 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:33.910836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:33.916329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:33.924152 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:33.924641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:33.928946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:33.929594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:34.004165 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:34.005089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:34.010561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-789c6afd-3f87-43fc-9719-df0c8d6d46cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 35585 microversion: 2.1 time: 0.104036 Sep 15 04:24:34.011712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 149/286] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:33 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 35585 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:34.014662 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:34.015251 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:34.015982 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:34.016429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:34.097568 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-08ab01c1-bbde-40e2-9e53-cd99a78997ec tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 37313 microversion: 2.20 time: 0.097979 Sep 15 04:24:34.098313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 138/287] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:33 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 37313 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:34.815830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:34.817311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:34.839111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:34.841654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:34.842598 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:34.843165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:35.024335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:35.026283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:35.035176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:35.036143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:35.037465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:35.038278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:35.136534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2dd2c231-1c94-479f-ba1f-304820dcfc1f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 36621 microversion: 2.1 time: 0.116417 Sep 15 04:24:35.138151 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 139/288] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:35 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 36621 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:35.146988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:35.148508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:35.156740 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:35.157494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:35.158391 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:35.159319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:35.198561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:35.208924 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-de9b1954-cd6c-4552-926e-8cd20561643e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.398536 Sep 15 04:24:35.216048 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 150/289] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:34 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:35.278262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-39d25838-f2c1-429f-8c2d-29401ca2934c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 38126 microversion: 2.20 time: 0.137962 Sep 15 04:24:35.278921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 140/290] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:35 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 38126 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:36.148929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:36.149853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:36.161255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.162514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.163378 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.163816 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.252011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:36.252753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:36.261006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.261478 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.262416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.262880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.463027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07831cad-55f2-4230-81e6-e09eae47c3c7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 37977 microversion: 2.1 time: 0.317448 Sep 15 04:24:36.464413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 151/291] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:36 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 37977 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:36.470540 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:36.471647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:36.478962 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.479535 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.480386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:36.481045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:36.530164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:36.543304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b31eb429-5dc1-419c-b93b-59a3d7ad4c26 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.298248 Sep 15 04:24:36.544180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 141/292] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:36 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:36.566265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-76221320-6efb-4325-8e9d-3525f113ffde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 38126 microversion: 2.20 time: 0.096900 Sep 15 04:24:36.571442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 152/293] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:36 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 38126 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:37.475319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:37.476269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:37.483476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.484165 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.485649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.486254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.566906 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:37.568072 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:37.573986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e5b9b3f1-110a-410a-ac90-ce2a19d1d850 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 38138 microversion: 2.1 time: 0.102426 Sep 15 04:24:37.574848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 142/294] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:37 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 38138 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:37.576961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.577496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.578478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.579214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.581999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:37.583594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:37.590460 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.591297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.592413 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:37.593158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:37.684252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5fc44900-764c-4d2f-a04f-991a6e82ec70 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 38126 microversion: 2.20 time: 0.107541 Sep 15 04:24:37.690926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 143/295] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:37 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 38126 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:37.799173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:37.810848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fcde4be0-a675-4b73-b593-c852a33275a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.251331 Sep 15 04:24:37.812422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 153/296] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:37 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:38.588661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:38.589463 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:38.597117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.597573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.598526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.598973 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.670385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4b7921db-ca8a-428a-91c4-0c093be8992c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 38138 microversion: 2.1 time: 0.086958 Sep 15 04:24:38.676126 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 144/297] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:38 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 38138 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:38.705583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:38.707466 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:38.721015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.722548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.724545 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.725235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.827241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f95d09bb-39b0-45ef-852e-537c4790c7dc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 200 len: 38269 microversion: 2.20 time: 0.131607 Sep 15 04:24:38.834350 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 154/298] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:38 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 38269 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:38.834527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:38.835252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:38.840403 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:38.840969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:38.846637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.847089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.849238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.851620 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.854142 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.855237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.858069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:38.858069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:38.897662 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c45bd1c9-ca9b-48a4-bd9a-b141033bc93c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/ips" status: 200 len: 152 microversion: 2.20 time: 0.061729 Sep 15 04:24:38.905636 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 155/299] 10.222.0.37 () {60 vars in 1289 bytes} [Wed Sep 15 04:24:38 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/ips => generated 152 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:39.050915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:39.068974 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f0ed9bfd-e95b-41aa-97a1-724a64996b4f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.237180 Sep 15 04:24:39.077401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 145/300] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:38 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:39.683580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:39.684985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:39.698354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:39.703469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:39.704606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:39.705412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:39.818997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-acc88882-e83c-41f6-85be-b63f8e93494d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 38191 microversion: 2.1 time: 0.140191 Sep 15 04:24:39.824999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 156/301] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:39 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 38191 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:40.096764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:40.098383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:40.107618 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.108640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:40.110011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.111197 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:40.424717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:40.434204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ef72ada8-56c9-4ede-8150-826026306b12 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.344122 Sep 15 04:24:40.437741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 146/302] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:40 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:40.834305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:40.836289 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:40.849986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.853877 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:40.855612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.856234 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:40.966539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-43ed3543-c8ca-4ff1-8381-a42a5b124a72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 200 len: 38269 microversion: 2.1 time: 0.137754 Sep 15 04:24:40.968015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 157/303] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:40 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 38269 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:24:40.981282 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:40.981781 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:40.993119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.993585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:40.994368 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:40.994809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:41.073443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a572f13a-184c-4f2e-87ce-ed8dcfd2f192 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/ips" status: 200 len: 147 microversion: 2.1 time: 0.095416 Sep 15 04:24:41.075057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 147/304] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:24:40 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/ips => generated 147 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:24:41.458657 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:41.458657 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:41.469166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:41.470540 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:41.481285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:41.481994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:41.606261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:41.606816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:41.613919 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:41.621175 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:41.622154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:41.622747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:41.901177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lazy-loading 'flavor' on Instance uuid 9af1a4f0-8870-46fa-8b33-7b855766dda3 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:24:42.049612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:42.060346 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bbf09b1f-75a1-4d81-9eca-c7ebe1a4364d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1502 microversion: 2.1 time: 0.608552 Sep 15 04:24:42.061693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 158/305] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:41 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1502 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:42.080325 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b390bd0e-84dd-421a-9d4a-ddde1cf5797f"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:42.081409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:42.096673 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.097360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.098561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.101223 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.170493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] HTTP exception thrown: Cannot 'attach_volume' instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e while it is in vm_state rescued Sep 15 04:24:42.171233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Returning 409 to user: Cannot 'attach_volume' instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e while it is in vm_state rescued {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:24:42.173677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8b618c5e-ad08-48d0-a258-3ceb6037f3d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099329 Sep 15 04:24:42.174449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 159/306] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:24:42 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 04:24:42.186616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:42.190001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:42.210557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.217343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.218551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.219482 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.342808 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cfc8715b-f2cb-45d8-b832-1f2ede469d1a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action" status: 202 len: 0 microversion: 2.1 time: 0.161576 Sep 15 04:24:42.352728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 160/307] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:42 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:24:42.362952 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:42.364075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:42.397442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.401356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.402974 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:42.408454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:42.747465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:42.775194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ee02e915-cd80-4bd5-8f9d-15cac4deb7a3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1510 microversion: 2.1 time: 0.420709 Sep 15 04:24:42.776471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 161/308] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:42 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:43.606729 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9658257b-c965-42ff-93aa-476768ba650b"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:43.608140 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:43.625105 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:43.625771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:43.626894 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:43.627701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:44.144864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2d7990c1-1110-43e3-bc3d-fcedc67ff4b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542936 Sep 15 04:24:44.150231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 162/309] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:24:43 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:24:44.161162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:44.162033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:44.178284 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:44.178915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:44.188569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:44.189568 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:44.411485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:44.425438 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d2e6df15-1614-4d7b-acd5-109caa7ff287 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1510 microversion: 2.1 time: 0.277388 Sep 15 04:24:44.426045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 163/310] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:44 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:44.619270 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Action: 'create', calling method: .version_select at 0x7f02a249cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-426019657"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:44.648362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for project 7dd0993d5a014825880ad0da74b21331. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:24:44.653794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for user 9a1c379e77c94773aaad49730f569a6f and project 7dd0993d5a014825880ad0da74b21331. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:24:45.798729 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for project 7dd0993d5a014825880ad0da74b21331. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:24:45.802352 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for user 9a1c379e77c94773aaad49730f569a6f and project 7dd0993d5a014825880ad0da74b21331. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:24:45.816401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-54d2ac75-1088-4e62-a2bd-527e1b2df51e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.389335 Sep 15 04:24:45.816995 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 164/311] 10.222.0.37 () {60 vars in 1158 bytes} [Wed Sep 15 04:24:44 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:45.821226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:45.821835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:45.827606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:45.828061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:45.829646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:45.830087 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:45.997056 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:46.005731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6b19a0b9-59dd-4897-9997-d7b1dd2b32af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1516 microversion: 2.1 time: 0.187711 Sep 15 04:24:46.006430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 165/312] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:45 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1516 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:47.494477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:47.495248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:47.502991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:47.503757 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:47.504966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:47.505583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:47.681559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:47.693001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a6cb9f33-00a7-4d7c-9bc3-5b37f8f94a70 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1516 microversion: 2.1 time: 0.202687 Sep 15 04:24:47.693576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 166/313] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:47 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:47.709240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "72f34da1-3d5a-42b8-a28d-3e5a07ad86dd"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:47.710173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:47.716108 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:47.716639 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:47.717504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:47.717925 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:48.007929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d236e100-5463-4c89-8423-1ae309ebef43 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302487 Sep 15 04:24:48.009226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 167/314] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:24:47 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:24:49.781414 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6b018699-8552-412a-b2aa-7b3cc452c0e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 202 len: 0 microversion: 2.20 time: 8.178611 Sep 15 04:24:49.782303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 148/315] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:24:41 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 0 bytes in 8180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 04:24:49.791344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:49.792041 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:49.800063 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:49.800506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:49.801448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:49.802000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:49.933094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:49.943226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:49.944931 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:49.946095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-92b5eda1-36d5-45b7-b96a-6aa88fa54662 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.159355 Sep 15 04:24:49.947399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 168/316] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:49 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:50.823270 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b5d249d2-d64b-4b3e-a673-dd9cc441b7ba tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:50.829832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5d249d2-d64b-4b3e-a673-dd9cc441b7ba tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:50.830275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5d249d2-d64b-4b3e-a673-dd9cc441b7ba tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:50.891634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b5d249d2-d64b-4b3e-a673-dd9cc441b7ba tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Going to try to stop instance {{(pid=108181) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 15 04:24:50.936942 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b5d249d2-d64b-4b3e-a673-dd9cc441b7ba tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 202 len: 0 microversion: 2.1 time: 0.117042 Sep 15 04:24:50.938008 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 149/317] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:50 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:24:50.946366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:50.947689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:50.961953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:50.962516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:50.963718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:50.964459 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:50.967245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:50.967963 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:50.974938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:50.975416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:50.976195 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:50.976632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:51.153722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:51.162148 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-99188880-cdd9-439c-a02e-35158227440c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.219888 Sep 15 04:24:51.162737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 169/318] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:50 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:51.167229 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:51.177089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:51.178997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:51.180521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a311a18f-2487-45d5-b6a6-df0d05be8b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.218229 Sep 15 04:24:51.181183 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 150/319] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:50 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:24:52.179821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:52.180585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:52.188481 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:52.188930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:52.189749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:52.190184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:52.200163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:52.200856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:52.207750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:52.208172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:52.208967 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:52.209432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:52.381913 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:52.384573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:52.391988 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7ebd3d24-4050-48b8-898d-4bef221aab49 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.215231 Sep 15 04:24:52.392849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 170/320] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:52 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:52.393190 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:52.395100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:52.396378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8880965d-c6bd-4063-a841-b30ec2c463b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.199794 Sep 15 04:24:52.396880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 151/321] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:52 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:53.411387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:53.412898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:53.420468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:53.421146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:53.422170 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:53.423068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:53.426294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:53.427317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:53.447119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:53.447766 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:53.448899 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:53.449340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:53.647487 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:53.655361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1da583c0-029f-43d9-b37b-2dc27ae1ac9d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.249561 Sep 15 04:24:53.655486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:53.655931 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 171/322] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:53 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:53.664843 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:53.666920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:53.668128 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-70c35a0e-a6a4-4514-a358-a532c5449dbb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.251650 Sep 15 04:24:53.668668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 152/323] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:53 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:24:54.672096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:54.672709 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:54.678304 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:54.678749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:54.679561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:54.679997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:54.685613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:54.686220 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:54.692694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:54.693140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:54.693907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:54.694336 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:54.875940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:54.885793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:54.890321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c85264e1-f3b3-4b9c-9cbc-30e752484cc0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.221507 Sep 15 04:24:54.898742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:54.900303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:54.901444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f629060c-d50f-4a7d-87b9-7febd667d438 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.219587 Sep 15 04:24:54.901812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 172/324] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:54 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:54.902237 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 153/325] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:54 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:55.909493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:55.910008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:55.916037 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:55.916506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:55.917305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:55.917768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:55.918140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:55.918746 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:55.925090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:55.925531 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:55.926292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:55.926722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:56.101926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:56.120267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:56.123704 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9303c677-dee1-438f-8757-25986111c05a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.218337 Sep 15 04:24:56.124222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 173/326] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:55 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:56.130927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:56.132514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:56.133685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-654d72d4-6e36-4377-af86-997462af2427 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.219150 Sep 15 04:24:56.134229 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 154/327] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:55 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:57.140413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:57.141402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:57.148097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.148538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.149351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.149784 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.151677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:57.152433 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:57.162266 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.165409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.167095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.167807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.323911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:57.333134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e5eef435-b1ee-4feb-86a2-d235afd3b762 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.196532 Sep 15 04:24:57.333922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 174/328] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:57 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:57.363637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:57.378698 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:57.380363 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:57.381973 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9328b842-f8fa-4c77-9cfb-d9900705094c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.233913 Sep 15 04:24:57.382526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 155/329] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:57 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:57.732392 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:24:57.734178 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:57.747368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.747368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.747368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.747368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.770118 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lazy-loading 'flavor' on Instance uuid 76d0ff04-6f6c-469a-b96d-0a01ba58779e {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:24:57.912402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-040e5028-b6f3-4e33-b48b-17d03e6aa6e8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action" status: 200 len: 32 microversion: 2.1 time: 0.185248 Sep 15 04:24:57.913007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 175/330] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:24:57 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action => generated 32 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:24:57.921997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:57.922747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:57.929484 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.930213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:57.931209 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:57.931642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:58.073437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:58.082697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cc0b5a75-e93e-43d0-ab8a-78ae470766cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.164436 Sep 15 04:24:58.083653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 156/331] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:57 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:24:58.353043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:58.353794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:58.361311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:58.361759 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:58.362543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:58.362976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:58.399959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:58.400756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:58.408204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:58.408769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:58.409645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:58.410298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:58.550738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:58.559258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-454149c9-2807-4c25-835a-f5608defea21 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.210428 Sep 15 04:24:58.560188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 176/332] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:58 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:58.585377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:58.593076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:58.595313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:58.596470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7fd7a63d-b6ea-42a5-954a-78d595ead8d2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.200420 Sep 15 04:24:58.597044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 157/333] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:58 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:24:59.100718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:59.101244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:59.107542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.107994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.109200 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.110103 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.239991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:59.248434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9ba8acec-fae3-48e2-a06f-549fadd8e14d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.151806 Sep 15 04:24:59.250968 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 177/334] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:59 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:59.576620 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:59.577309 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:59.583153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.583687 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.584514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.585013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.614818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:24:59.615419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:24:59.621288 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.621740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.622512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:24:59.622951 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:24:59.747558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:59.759170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9b4860c7-d28d-468d-97a3-4f1f9a740895 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.185953 Sep 15 04:24:59.760121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 158/335] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:24:59 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:24:59.795302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:59.804280 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:59.805962 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:24:59.807239 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cc61308c-5c9d-4c51-9b94-9c1d4bff8814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.196339 Sep 15 04:24:59.808272 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 178/336] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:24:59 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:00.266736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:00.267405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:00.273497 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.273950 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:00.274824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.275292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:00.394722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:00.402435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0c14dbe1-3366-4987-aa35-d6682fe81557 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.140271 Sep 15 04:25:00.403036 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 159/337] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:00 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:00.781171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:00.783960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:00.793392 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.793856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:00.794627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.795060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:00.827147 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:00.827893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:00.834492 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.834947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:00.835752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:00.836189 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:01.009081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:01.017375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f9538ffd-266c-4ccb-a233-3dd8a9155e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.243356 Sep 15 04:25:01.018029 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 179/338] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:00 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:01.037905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:01.047557 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:01.049280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:01.050582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4612cef3-89f2-4332-a56d-1440a78dceda tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.227112 Sep 15 04:25:01.051419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 160/339] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:00 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:01.420199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:01.420804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:01.426474 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:01.426916 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:01.427710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:01.428325 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:01.560166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:01.569875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ddeb9d9e-f7b9-4841-99e3-abc860c0337e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.153548 Sep 15 04:25:01.570468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 180/340] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:01 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:02.034026 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:02.034638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:02.040459 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.040909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.041673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.042102 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.072092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:02.072873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:02.080243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.080890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.081863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.082483 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.190051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:02.197928 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3bd66f8f-51f6-4eb5-96ea-a00a8f5a917d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.168156 Sep 15 04:25:02.207505 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 161/341] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:02 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:02.247823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:02.255934 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:02.257473 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:02.258674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b333227a-605b-4178-8c48-a0c2a3deec77 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.192366 Sep 15 04:25:02.259243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 181/342] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:02 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:02.586976 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:02.587762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:02.593605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.594181 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.594871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:02.595342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:02.729191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:02.737472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5f4a448d-f4c2-449a-bff9-181ce964626d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.154047 Sep 15 04:25:02.738043 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 162/343] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:02 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:03.218389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:03.219018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:03.225372 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.225819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.226593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.227025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.277259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:03.277871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:03.283773 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.284222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.284996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.285431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.386735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:03.395530 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-11e6d9d9-dc03-4855-83a3-09bc0c5027a1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.183107 Sep 15 04:25:03.396091 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 182/344] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:03 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:03.438214 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:03.446045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:03.447728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:03.449153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1f9ed76e-a0ae-40fe-adbe-1491e55eb9fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.175529 Sep 15 04:25:03.449869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 163/345] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:03 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:03.755731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:03.756251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:03.761978 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.762426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.763215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:03.763649 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:03.885911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:03.893753 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e6ae828d-0139-4c3c-af67-909424d01999 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.142048 Sep 15 04:25:03.894313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 183/346] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:03 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:04.413738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:04.414962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:04.421373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.421826 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:04.423356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.423804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:04.468291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:04.468907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:04.475329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.475784 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:04.476572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.477010 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:04.598992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:04.606805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a468102a-69d8-48f2-b837-8746dc80015f tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.197510 Sep 15 04:25:04.607400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 164/347] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:04 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:04.653805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:04.661667 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:04.663202 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:04.664364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8769c03e-208a-45ab-a99e-3150953ee3d6 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.199767 Sep 15 04:25:04.664919 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 184/348] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:04 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:04.910706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:04.911461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:04.917540 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.917995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:04.918770 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:04.919248 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:05.043553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:05.051652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-095f97ba-b294-4484-9208-fe9a8bd2a984 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.145367 Sep 15 04:25:05.052211 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 165/349] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:04 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:05.624692 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:05.626195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:05.633908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:05.633908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:05.633908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:05.634242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:05.685822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:05.686433 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:05.693435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:05.693816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:05.694600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:05.695019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:05.802770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:05.811745 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a9dd79b9-2548-4d0f-acf6-47978ba5d10c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1725 microversion: 2.1 time: 0.190628 Sep 15 04:25:05.812581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 185/350] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:05 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:05.854538 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:05.863437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:05.865524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:05.866801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d0d0b5a1-6467-4daa-87f6-0ee062073b07 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.187733 Sep 15 04:25:05.867684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 166/351] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:05 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:06.069255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:06.070128 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:06.076766 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.077141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.077910 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.078506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.241572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:06.249628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-228d6808-b267-4312-b247-538b920d1934 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.184365 Sep 15 04:25:06.250206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 186/352] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:06 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:06.830351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:06.830961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:06.836807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.837246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.838003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.838430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.885739 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:06.886325 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:06.892883 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.893449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.894259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:06.894694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:06.984986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:06.992854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-92d1fa04-c6c9-4545-83bf-226412d246b6 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1702 microversion: 2.1 time: 0.166822 Sep 15 04:25:06.993516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 167/353] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:06 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1702 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:07.010571 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-961d33b2-047a-434c-b0c5-82c86dede0a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:07.016429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-961d33b2-047a-434c-b0c5-82c86dede0a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:07.017659 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-961d33b2-047a-434c-b0c5-82c86dede0a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:07.039065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-961d33b2-047a-434c-b0c5-82c86dede0a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Going to try to start instance {{(pid=108181) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 15 04:25:07.040088 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:07.047914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:07.049456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:07.050637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b04207f7-3065-432a-aa36-818dfbcebf82 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.168701 Sep 15 04:25:07.051276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 187/354] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:06 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:07.080935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-961d33b2-047a-434c-b0c5-82c86dede0a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 202 len: 0 microversion: 2.1 time: 0.073767 Sep 15 04:25:07.081464 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 168/355] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:25:07 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:25:07.089260 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:07.089908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:07.096051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:07.096546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:07.097319 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:07.097751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:07.239414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:07.252226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e63d63bb-e4c7-4744-9c83-f0d57985bad7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1711 microversion: 2.1 time: 0.166250 Sep 15 04:25:07.253168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 188/356] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:07 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1711 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:07.266200 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:07.267783 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:07.274335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:07.274793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:07.275604 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:07.276038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:07.425195 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:07.434614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-782f55ee-f4b3-4eb8-b5cc-6521b45f154f tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.172296 Sep 15 04:25:07.435558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 169/357] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:07 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:08.070215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:08.070871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:08.076800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.077246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.078001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.078433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.197842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:08.205743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:08.207282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:08.208442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-23faf811-f883-48c8-9361-aa188eae9633 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.142366 Sep 15 04:25:08.208990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 189/358] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:08 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:08.272566 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:08.273186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:08.278994 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.279483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.280265 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.280703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.395750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1735155651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-460250898", "security_groups": [{"name": "tempest-secgroup-smoke-1810072556"}], "block_device_mapping_v2": [{"uuid": "17ea9873-0490-424c-bf5c-14f09450e40d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:08.408704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:08.417201 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7454548a-5988-4de2-9aa1-9067c22b1f2e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1711 microversion: 2.1 time: 0.150919 Sep 15 04:25:08.417766 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 170/359] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:08 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1711 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:08.459083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:08.460000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:08.465844 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.466481 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.467282 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:08.467716 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:08.507704 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] validate_networks() for [('cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:25:08.694321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:08.702105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7ac0635c-4e2b-4c4c-8314-e9def64e7ad5 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.253007 Sep 15 04:25:08.702756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 171/360] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:08 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:09.134909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:25:09.135397 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:25:09.135897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:25:09.136309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:25:09.136727 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:25:09.145907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.146352 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.147187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.147633 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.164330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:25:09.168153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for user fc599faf327249919f8dc76e65061ae3 and project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:25:09.226028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:09.226752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:09.229163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:25:09.231360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17ea9873-0490-424c-bf5c-14f09450e40d',volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:25:09.233520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.234060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.234948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.236134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.367195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-85ecb321-38f0-4538-a1d8-0df6ea550ba3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.975551 Sep 15 04:25:09.367916 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 190/361] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:25:08 2021] POST /compute/v2.1/servers => generated 406 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 04:25:09.369478 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.377907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f08462c3-5c5d-4328-abd6-7b0c0bdf24a9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:09.378754 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f08462c3-5c5d-4328-abd6-7b0c0bdf24a9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:09.379627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.381269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.382477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3859e522-76ce-4912-b3cf-5060bb1dd2ea tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.160089 Sep 15 04:25:09.383062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 172/362] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:09 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:09.433611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:09.434227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:09.437524 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f08462c3-5c5d-4328-abd6-7b0c0bdf24a9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.442807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.443449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.444327 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.445006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.446197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f08462c3-5c5d-4328-abd6-7b0c0bdf24a9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1094 microversion: 2.1 time: 0.072240 Sep 15 04:25:09.451113 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 191/363] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:09 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:09.574527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.583378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7ade56b9-409c-4393-a4e2-3c8861d22b67 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1711 microversion: 2.1 time: 0.153359 Sep 15 04:25:09.583972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 173/364] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:09 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:09.719522 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:09.720141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:09.725935 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.726389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.727258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:09.727911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:09.856551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:09.865277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0457eac4-71f5-4a56-899f-f086c910acab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.149563 Sep 15 04:25:09.865845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 192/365] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:09 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:10.401824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:10.402397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:10.409612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.410059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.410869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.411356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.467400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:10.468204 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:10.474884 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.475369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.476139 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.476573 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.539596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:10.546829 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9253d27c-efd6-462c-bfde-5c26c66179ff tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1144 microversion: 2.1 time: 0.083252 Sep 15 04:25:10.547499 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 193/366] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:10 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:10.555714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:10.564261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:10.565904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:10.567072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f53aa87d-98eb-4299-9c21-a9672cdcec78 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.169080 Sep 15 04:25:10.567657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 174/367] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:10 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:10.599953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:10.600563 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:10.606413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.606859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.607797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.608235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.727254 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:10.735055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6cca3264-d828-4d33-bbe8-d2f8ada01e72 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1711 microversion: 2.1 time: 0.138673 Sep 15 04:25:10.735678 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 194/368] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:10 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1711 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:10.881786 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:10.882408 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:10.888589 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.889044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:10.889822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:10.890300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.018476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.026946 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-82738e5a-b923-4a97-83cf-f59e3bc30220 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.149032 Sep 15 04:25:11.027532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 175/369] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:10 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:11.562948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:11.565016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:11.570800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.571282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.572055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.572544 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.585003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:11.585629 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:11.600947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.601485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.607957 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.608489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.645512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.653401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0547b491-00af-4e74-9b4b-27215bd2e861 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1210 microversion: 2.1 time: 0.094362 Sep 15 04:25:11.654316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 195/370] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:11 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:11.738350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.752175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:11.753186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:11.757508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.759028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.760245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-af3c957b-e273-4a48-acbd-0182920c36f0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1746 microversion: 2.20 time: 0.178890 Sep 15 04:25:11.771950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.771950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.771950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:11.771950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:11.772264 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 176/371] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:11 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1746 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:11.887778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:11.895821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e2937d42-cd92-494c-b909-3a8c0c38a113 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1715 microversion: 2.1 time: 0.147726 Sep 15 04:25:11.896322 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 196/372] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:11 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1715 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:12.044357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:12.045136 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:12.051937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.052392 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.053171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.053610 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.191807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:12.202556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-72e1990c-ae4a-4e8a-8a7c-cdf1158a6377 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.161930 Sep 15 04:25:12.203375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 177/373] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:12 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:12.669787 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:12.670915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:12.678155 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.678783 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.679796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.680333 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.779281 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:12.781061 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:12.787341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.787997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.788927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.789536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.818865 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:12.826414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ed6349f1-f77b-4393-bc24-f1fbd9928289 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1278 microversion: 2.1 time: 0.160352 Sep 15 04:25:12.826981 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 197/374] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:12 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:12.889946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-5b12d7e9-b1e5-464f-b96f-a1bdf97bd80e req-6122fd83-a0d4-435e-a69f-91eb9aabb06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551493b4-5ef7-4c4d-9b6a-d89dcaf16dde", "tag": "924bd0c9-8dca-4c2c-98d4-521045ba17e5"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:12.891663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:12.891663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:25:12.903609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5b12d7e9-b1e5-464f-b96f-a1bdf97bd80e req-6122fd83-a0d4-435e-a69f-91eb9aabb06e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:12.904043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5b12d7e9-b1e5-464f-b96f-a1bdf97bd80e req-6122fd83-a0d4-435e-a69f-91eb9aabb06e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:12.916678 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-5b12d7e9-b1e5-464f-b96f-a1bdf97bd80e req-6122fd83-a0d4-435e-a69f-91eb9aabb06e service nova] Creating event network-changed:924bd0c9-8dca-4c2c-98d4-521045ba17e5 for instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde on hv-cinder-76015 Sep 15 04:25:12.925616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-5b12d7e9-b1e5-464f-b96f-a1bdf97bd80e req-6122fd83-a0d4-435e-a69f-91eb9aabb06e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043444 Sep 15 04:25:12.926216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 198/375] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:12.961240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:12.970089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:12.971978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:12.973153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-473027a2-0fae-4ff4-a201-0a9d148bdd1e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1746 microversion: 2.20 time: 0.197881 Sep 15 04:25:12.973702 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 178/376] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:12 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1746 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:13.220642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:13.221463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:13.227695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:13.228150 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:13.228959 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:13.229400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:13.359442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:13.367548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-32ddc0fb-f915-44b8-9bb6-4a65aedf6dad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.151720 Sep 15 04:25:13.368118 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 199/377] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:13 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:13.843282 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:13.843888 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:13.849649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:13.850093 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:13.850847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:13.851308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:13.970060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:13.977181 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b0c00d46-3f1a-43e9-939f-c2f6185f3078 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1278 microversion: 2.1 time: 0.137628 Sep 15 04:25:13.977741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 179/378] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:13 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:13.992297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:13.992898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:13.998566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:13.999009 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:13.999798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:14.000230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:14.124800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:14.135791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:14.137280 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:14.138431 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cf199f52-2570-4967-96ac-17621618ec31 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1746 microversion: 2.20 time: 0.150259 Sep 15 04:25:14.138980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 200/379] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:13 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:14.384031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:14.384644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:14.390466 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:14.390920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:14.391739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:14.392178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:14.519275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:14.528897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7754070a-0b2e-4655-8279-ece38d399e8e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.148456 Sep 15 04:25:14.529526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 180/380] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:14 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:14.993522 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:14.995615 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:15.002561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.003096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.003985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.004490 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.136359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:15.151343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5766480c-a386-42c5-a3a0-d708185762c2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.161308 Sep 15 04:25:15.152432 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 201/381] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:14 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:15.166300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:15.167552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:15.175029 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.175799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.176880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.177512 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.372360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:15.382292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:15.384015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:15.385553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-513dc8d4-b88a-45ba-bf43-f4a375670a3a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.222920 Sep 15 04:25:15.397035 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 181/382] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:15 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:15.546061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:15.546936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:15.553750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.554496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.555820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:15.556632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:15.694061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:15.704583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b4c4734f-4907-4bbd-b7e9-120cc788659c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.161867 Sep 15 04:25:15.705256 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 202/383] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:15 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:16.170178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:16.171530 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:16.178292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.178949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.180305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.180901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.315243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:16.323745 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bb7194a3-709d-4b72-8ca6-2a2f580e4ac3 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.157617 Sep 15 04:25:16.324465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 182/384] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:16 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:16.404937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:16.405814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:16.417159 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.419534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.420416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.420802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.588675 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:16.599798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:16.601590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:16.603357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fe5accad-525c-4893-b9ff-a20793c129ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.203088 Sep 15 04:25:16.604310 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 203/385] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:16 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:16.678349 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-a5427b51-d2fa-47c2-a062-ba5c7a6fb58d req-37a22a33-16ee-4558-9a81-8b83420133ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "name": "network-vif-plugged", "status": "completed", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:16.679888 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:16.679888 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:25:16.692468 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-a5427b51-d2fa-47c2-a062-ba5c7a6fb58d req-37a22a33-16ee-4558-9a81-8b83420133ac service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.693188 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-a5427b51-d2fa-47c2-a062-ba5c7a6fb58d req-37a22a33-16ee-4558-9a81-8b83420133ac service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.728412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:16.729092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:16.746605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-a5427b51-d2fa-47c2-a062-ba5c7a6fb58d req-37a22a33-16ee-4558-9a81-8b83420133ac service nova] Creating event network-vif-plugged:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:25:16.748875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.750171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.751919 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:16.752523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:16.763019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-a5427b51-d2fa-47c2-a062-ba5c7a6fb58d req-37a22a33-16ee-4558-9a81-8b83420133ac service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088150 Sep 15 04:25:16.768122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 183/386] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:25:16.973985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:16.992932 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d14557f8-f57a-4960-a20f-2e54e89639d1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.269438 Sep 15 04:25:16.993812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 204/387] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:16 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:17.341611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:17.342904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:17.350152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:17.350637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:17.351621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:17.352185 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:17.476611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:17.485691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ec57df93-cac5-497f-90b6-74c3f99cd4a8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.147435 Sep 15 04:25:17.486268 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 184/388] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:17 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:17.625515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:17.626714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:17.632945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:17.633395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:17.634312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:17.634748 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:17.770699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:17.782309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:17.784842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:17.786059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3c32e1e7-ee0c-4ad1-8124-9b3d8f29565c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.167209 Sep 15 04:25:17.786624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 205/389] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:17 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:18.010338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:18.011357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:18.020657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.021204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.022436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.022901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.174376 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:18.183161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ca17cc4f-deee-4f0a-8245-014bec652e3d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.176567 Sep 15 04:25:18.183761 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 185/390] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:18 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:18.502072 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:18.502845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:18.509747 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.510303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.511122 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.511579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.642986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:18.653021 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-67223d2e-84bb-4af3-ba7c-93598b3ca36d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.154560 Sep 15 04:25:18.653980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 206/391] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:18 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:18.804368 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:18.804931 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:18.810920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.811438 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.812507 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:18.813646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:18.952060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:18.962171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:18.963841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:18.965092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e19a9d2c-2a78-4fbe-b676-5c9f1b2f95a7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.164460 Sep 15 04:25:18.965873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 186/392] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:18 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:19.200836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:19.201460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:19.211780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.212390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:19.213593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.214099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:19.361464 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:19.374321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7c7476ee-7ac2-444d-b387-5db843c8e154 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.177554 Sep 15 04:25:19.374926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 207/393] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:19 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:19.669865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:19.670526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:19.677462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.678138 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:19.679432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.680036 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:19.827340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:19.838210 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-20f3e378-5aa6-4517-b061-2ae02f97b4e4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.172105 Sep 15 04:25:19.838916 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 187/394] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:19 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:19.983264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:19.984047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:19.992110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.992796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:19.993751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:19.994368 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:20.140840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:20.149003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:20.151227 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:20.155180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7320da9e-2fc5-4a75-a8e8-63d6c9380a23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.174488 Sep 15 04:25:20.156356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 208/395] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:19 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:20.392512 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:20.393052 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:20.399695 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:20.400225 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:20.401504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:20.402163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:20.566739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:20.575030 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-29e94fca-41cc-4502-a449-a8ab5cacc37a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.186545 Sep 15 04:25:20.585524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 188/396] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:20 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:20.855566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:20.856533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:20.864092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:20.864543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:20.865335 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:20.865772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:21.050155 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:21.064182 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9fba3341-e1b2-4624-9a0f-ef46800c312a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.211581 Sep 15 04:25:21.064905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 209/397] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:20 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:21.182595 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:21.183324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:21.190135 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:21.190601 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:21.191410 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:21.191845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:21.324119 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:21.332412 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:21.334118 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:21.335477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2ce9a255-5a5d-42e2-897d-c3d9120004f3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.157956 Sep 15 04:25:21.336487 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 189/398] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:21 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:21.592684 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:21.593246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:21.600050 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:21.600713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:21.601729 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:21.602257 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:21.746912 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:21.755713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4b298319-663c-4bdb-93a9-b1d49634c877 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.166802 Sep 15 04:25:21.765712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 210/399] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:21 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:21.838983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-616538700", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-426019657", "security_groups": [{"name": "tempest-secgroup-smoke-1821218796"}], "networks": [{"uuid": "fd4fb6c4-8ad4-4ecb-a3f9-0b2605623e64"}], "block_device_mapping_v2": [{"uuid": "e3bff23d-ec2f-4469-8fee-507d3999cb9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:21.960104 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] validate_networks() for [('fd4fb6c4-8ad4-4ecb-a3f9-0b2605623e64', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:25:22.088818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:22.090498 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:22.101008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.105412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.106346 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.106861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.341036 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:22.349557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-963cf653-40cc-44dd-9368-fd02a604a011 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.267645 Sep 15 04:25:22.354028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 211/400] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:22 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:22.368990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:22.370203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:22.379095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.379855 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.381094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.381679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.574445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:25:22.575628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:25:22.576209 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:25:22.576685 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:25:22.577291 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:25:22.589345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.591380 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.597586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.598668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.629850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:22.636045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for project 7dd0993d5a014825880ad0da74b21331. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:25:22.639790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:22.640706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Getting quotas for user 9a1c379e77c94773aaad49730f569a6f and project 7dd0993d5a014825880ad0da74b21331. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:25:22.642289 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:22.644240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-95e93649-4d5a-47ad-b283-4c36462f975f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.288668 Sep 15 04:25:22.644807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 212/401] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:22 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:22.708348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:25:22.710588 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e3bff23d-ec2f-4469-8fee-507d3999cb9a',volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:25:22.772647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:22.773251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:22.779438 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.780086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.781045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:22.781990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:22.864269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-81d23cd3-0205-4454-bd25-7a03a97f1274 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.028886 Sep 15 04:25:22.865521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 190/402] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:25:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:25:22.877868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e802f87a-5c65-407a-a983-c3b473044d49 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:22.878703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e802f87a-5c65-407a-a983-c3b473044d49 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:22.946710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:22.954978 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4d7a1c48-6cb9-4666-ba1e-dcd1c4979b13 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.186065 Sep 15 04:25:22.957854 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 213/403] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:22 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:22.988191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e802f87a-5c65-407a-a983-c3b473044d49 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:23.009106 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e802f87a-5c65-407a-a983-c3b473044d49 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1087 microversion: 2.1 time: 0.134506 Sep 15 04:25:23.009662 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 191/404] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:22 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1087 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:23.370761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:23.371643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:23.383490 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.384103 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:23.385312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.385904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:23.548413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:23.556033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c42458cd-230a-430b-a422-e8186e61cc0b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.188881 Sep 15 04:25:23.560063 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 214/405] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:23 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:23.662539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:23.663804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:23.669776 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.670234 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:23.671155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.671935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:23.812750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:23.822351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:23.824141 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:23.825543 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2fdfb389-1ecb-4fca-a98b-09d9a8f0e6b8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.167058 Sep 15 04:25:23.826272 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 192/406] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:23 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:23.972797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:23.973442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:23.980819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.981564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:23.982516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:23.983104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.032418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:24.037394 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:24.052665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.053824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.054873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.055503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.206460 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:24.220938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f9cb4ae4-e05d-4cb3-9d89-44cdd83fcdb1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1193 microversion: 2.1 time: 0.198421 Sep 15 04:25:24.231805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 193/407] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:24 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1193 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:24.252458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:24.260668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d59f2c9b-b442-4fa0-b07b-ea7d479256b1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.292104 Sep 15 04:25:24.261373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 215/408] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:23 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:24.573951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:24.575061 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:24.592078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.592811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.594594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.595333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.815083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:24.831445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b099bf2b-7a53-4b13-a4ce-c05b8e088bbe tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.261849 Sep 15 04:25:24.839718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 194/409] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:24 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:24.846611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:24.848538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:24.854362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-89b5fccb-0d9b-4dda-a53c-1d661ca6a5f4 req-8a4797bd-37c7-47ac-a344-e1adbb3be97c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551493b4-5ef7-4c4d-9b6a-d89dcaf16dde", "name": "network-vif-plugged", "status": "completed", "tag": "924bd0c9-8dca-4c2c-98d4-521045ba17e5"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:24.857596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.858265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.859259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.861220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.862204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:24.862204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:25:24.878938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-89b5fccb-0d9b-4dda-a53c-1d661ca6a5f4 req-8a4797bd-37c7-47ac-a344-e1adbb3be97c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:24.879795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-89b5fccb-0d9b-4dda-a53c-1d661ca6a5f4 req-8a4797bd-37c7-47ac-a344-e1adbb3be97c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:24.910285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-89b5fccb-0d9b-4dda-a53c-1d661ca6a5f4 req-8a4797bd-37c7-47ac-a344-e1adbb3be97c service nova] Creating event network-vif-plugged:924bd0c9-8dca-4c2c-98d4-521045ba17e5 for instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde on hv-cinder-76015 Sep 15 04:25:24.916371 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-89b5fccb-0d9b-4dda-a53c-1d661ca6a5f4 req-8a4797bd-37c7-47ac-a344-e1adbb3be97c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066208 Sep 15 04:25:24.917711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 195/410] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:25:25.153502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:25.166564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:25.168968 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:25.170153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a57da905-cc77-452a-b1bf-4f24602566bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1741 microversion: 2.20 time: 0.330290 Sep 15 04:25:25.171233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 216/411] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:24 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1741 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:25.240329 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:25.241328 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:25.249277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.251174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.252184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.253055 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.290869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:25.291779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:25.298297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.301485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.302580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.307268 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.502802 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:25.514311 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8f81d849-76f5-4806-9057-6d18256487e6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.280060 Sep 15 04:25:25.515404 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 196/412] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:25 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:25.541334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:25.549949 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a3031c12-c20f-4799-9577-f4094707cb0e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.276009 Sep 15 04:25:25.550522 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 217/413] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:25 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:25.858840 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:25.861684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:25.868379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.869625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-b953a31e-e267-4991-9647-e59aa6914a93 req-4dfcab78-986e-4c06-88c2-9dd8c923d3da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:25.871785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:25.871785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:25:25.872923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.874728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.876686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.880744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-b953a31e-e267-4991-9647-e59aa6914a93 req-4dfcab78-986e-4c06-88c2-9dd8c923d3da service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:25.881365 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-b953a31e-e267-4991-9647-e59aa6914a93 req-4dfcab78-986e-4c06-88c2-9dd8c923d3da service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:25.922777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-b953a31e-e267-4991-9647-e59aa6914a93 req-4dfcab78-986e-4c06-88c2-9dd8c923d3da service nova] Creating event network-changed:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:25:25.927920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-b953a31e-e267-4991-9647-e59aa6914a93 req-4dfcab78-986e-4c06-88c2-9dd8c923d3da service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061653 Sep 15 04:25:25.928840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 218/414] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:25:26.059971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.069031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-adf3965f-a1bb-41f0-9cc5-2533898194d1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1266 microversion: 2.1 time: 0.216836 Sep 15 04:25:26.069914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 197/415] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:25 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:26.196982 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:26.197760 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:26.205376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.205863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.206658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.207098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.395174 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.417429 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.419353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.420737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ad413a8b-2913-45e0-a1be-f9f99522b1eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1723 microversion: 2.20 time: 0.228095 Sep 15 04:25:26.421309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 219/416] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:26 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:26.538180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:26.538855 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:26.548816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.549766 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.550817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.551400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.567771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:26.568641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:26.577335 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.578173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.579481 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:26.580054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:26.860160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.869228 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-67220c06-6268-4eff-8ad9-59ff2a0279e8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.335596 Sep 15 04:25:26.869827 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 198/417] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:26 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:26.883631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:26.893445 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ec686d64-9205-473e-ad3e-0d6e8fdf8282 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.330827 Sep 15 04:25:26.894024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 220/418] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:26 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:27.086545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:27.087921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:27.094650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.095169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.095977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.096420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.219529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:27.227227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1f9982c3-6fd2-424c-aecf-d921c00de01e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1454 microversion: 2.1 time: 0.144787 Sep 15 04:25:27.228152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 199/419] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:27 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1454 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:27.243861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:27.244375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:27.250588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.251300 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.252068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.252499 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.376244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:27.383558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2835c755-f45b-4c44-af57-897298df370a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1454 microversion: 2.1 time: 0.143377 Sep 15 04:25:27.384212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 221/420] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:27 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:27.440820 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:27.441508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:27.447616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.448177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.449246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.449784 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.610597 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:27.620100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:27.621789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:27.623165 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2b15c060-9722-498b-b7c0-92a765d8405f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1723 microversion: 2.20 time: 0.187162 Sep 15 04:25:27.623711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 200/421] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:27 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:27.888931 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:27.888931 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:27.893229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.893772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.894475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.894922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.913021 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:27.914824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:27.924379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.925416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:27.926386 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:27.926987 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:28.091043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:28.099443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:28.100382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e16b2797-6126-43f4-a267-63ef019f90c6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.218338 Sep 15 04:25:28.101151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 222/422] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:27 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:28.113245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-533d5be6-f9a9-42f1-9208-2d79171ec3d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.207073 Sep 15 04:25:28.113823 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 201/423] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:27 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:28.640651 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:28.642074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:28.649755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:28.650292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:28.651157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:28.651722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:28.816412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:28.824364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:28.827860 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:28.829644 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9fcd272c-ec0c-4187-a39c-35278f3ffdb8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1723 microversion: 2.20 time: 0.192939 Sep 15 04:25:28.830193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 223/424] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:28 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:29.118193 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:29.118972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:29.127425 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.128152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.128983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.129760 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.130853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:29.131496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:29.142535 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.142982 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.145129 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.145746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.335705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:29.344677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:29.349456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-76906f5e-41f9-49c9-9f49-dd0afc14fd0b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.234810 Sep 15 04:25:29.356326 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bfef96da-6fc0-4f13-9c1e-7b2603f39c21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.229079 Sep 15 04:25:29.358022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 224/425] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:29 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:29.358551 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 202/426] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:29 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:29.573295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-2a8ecf1d-687e-4773-94cb-8418843cf2f7 req-d12535ac-56a7-4936-bdd2-2af38700c2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551493b4-5ef7-4c4d-9b6a-d89dcaf16dde", "tag": "924bd0c9-8dca-4c2c-98d4-521045ba17e5"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:29.574459 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:29.574459 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:25:29.582268 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2a8ecf1d-687e-4773-94cb-8418843cf2f7 req-d12535ac-56a7-4936-bdd2-2af38700c2e6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.582715 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2a8ecf1d-687e-4773-94cb-8418843cf2f7 req-d12535ac-56a7-4936-bdd2-2af38700c2e6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.593384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-2a8ecf1d-687e-4773-94cb-8418843cf2f7 req-d12535ac-56a7-4936-bdd2-2af38700c2e6 service nova] Creating event network-changed:924bd0c9-8dca-4c2c-98d4-521045ba17e5 for instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde on hv-cinder-76015 Sep 15 04:25:29.598419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-2a8ecf1d-687e-4773-94cb-8418843cf2f7 req-d12535ac-56a7-4936-bdd2-2af38700c2e6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029217 Sep 15 04:25:29.599008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 225/427] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:29.848314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:29.849132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:29.855296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.856030 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:29.856906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:29.857446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.037995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:30.046752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:30.049216 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:30.050434 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-74a5304d-49dd-4d4e-bdd3-fff0915fafcb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1666 microversion: 2.20 time: 0.206779 Sep 15 04:25:30.065395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 203/428] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:29 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:30.069305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cb372d5-bdf2-4b5f-aa5d-0d5575d801ae"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:30.071070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:30.077359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.078445 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.079749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.080387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.366730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:30.367500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:30.374745 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.375369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.376194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.376630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.409534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9aa3d918-9cd0-47a9-83cb-404f8c6f4623 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.344168 Sep 15 04:25:30.411239 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 226/429] 10.222.0.37 () {62 vars in 1364 bytes} [Wed Sep 15 04:25:30 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:25:30.416873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:30.418357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:30.429117 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.429578 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.430437 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.430885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.794666 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:30.805416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d2ef44f3-4635-4862-992a-3077d235adcf tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.442231 Sep 15 04:25:30.806230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 204/430] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:30 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:30.811757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:30.813289 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:30.819155 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:30.819706 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.820262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.821686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.822143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.828363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fd0be868-0f8e-4377-a771-f1f968acc006 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.415788 Sep 15 04:25:30.829249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 227/431] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:30 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:30.841151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-783e8ec1-6e33-4a0a-b8e8-3060e4beb982 req-c299288a-f991-4e12-afb1-b54d7841fd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "name": "network-vif-unplugged", "status": "completed", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:30.843044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:30.843044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:25:30.850373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-783e8ec1-6e33-4a0a-b8e8-3060e4beb982 req-c299288a-f991-4e12-afb1-b54d7841fd29 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.850805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-783e8ec1-6e33-4a0a-b8e8-3060e4beb982 req-c299288a-f991-4e12-afb1-b54d7841fd29 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.864399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.compute.server_external_events [req-783e8ec1-6e33-4a0a-b8e8-3060e4beb982 req-c299288a-f991-4e12-afb1-b54d7841fd29 service nova] Unable to find a host for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3. Dropping event network-vif-unplugged {{(pid=108182) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 15 04:25:30.865362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-783e8ec1-6e33-4a0a-b8e8-3060e4beb982 req-c299288a-f991-4e12-afb1-b54d7841fd29 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035257 Sep 15 04:25:30.866022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 228/432] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:30 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 15 04:25:30.920433 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-72646f37-cfff-4cdd-9b44-929d80ec6255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action" status: 202 len: 0 microversion: 2.20 time: 0.112946 Sep 15 04:25:30.921127 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 205/433] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:25:30 2021] POST /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:25:30.930891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:30.931533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:30.938015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.939112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:30.939908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:30.940351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:31.068081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:31.076717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:31.079475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:31.080791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-97e5c445-9e0d-4feb-91cf-689ed730e5cc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1752 microversion: 2.20 time: 0.153622 Sep 15 04:25:31.083173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 229/434] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:30 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:31.823418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:31.824191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:31.831513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:31.831959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:31.832727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:31.833164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:31.846887 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:31.847824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:31.854000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:31.854475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:31.855350 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:31.855723 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:32.029033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:32.035873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:32.036663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-884c00c4-1836-4053-9985-a9e77ca58bdd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.216921 Sep 15 04:25:32.037307 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 206/435] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:31 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:32.043681 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-99749c36-ec20-4100-8e65-ec0be29fe08c tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.202000 Sep 15 04:25:32.044233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 230/436] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:31 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:32.099380 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:32.099986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:32.105891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:32.106285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:32.107040 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:32.107501 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:32.232105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:32.244527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:32.246108 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:32.247359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1fb0f32d-23c0-403b-b4ee-85cd948dc7f4 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1754 microversion: 2.20 time: 0.151649 Sep 15 04:25:32.247914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 207/437] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:32 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:33.053357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:33.053964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:33.060105 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.060548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.061180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:33.061594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.061762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.061875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:33.068142 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.068582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.069338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.069767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.243225 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:33.248149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:33.251454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fcf7e1fe-cab5-41e5-be44-2a1d29baa09a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.201655 Sep 15 04:25:33.252038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 231/438] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:33 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:33.266645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:33.267288 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:33.273202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6d9e831f-559c-4e59-90be-4b21076ef96d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.214736 Sep 15 04:25:33.273363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.273962 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.274081 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 208/439] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:33 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:33.274778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:33.275400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:33.469485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:33.479742 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:33.481238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:33.482394 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4db4902f-f1e2-4a3a-bfac-41c90913271c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.220032 Sep 15 04:25:33.483003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 232/440] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:33 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:34.267876 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:34.268632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:34.275177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.275860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.277122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.277122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.290984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:34.292358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:34.300029 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.300941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.302238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.302873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.536797 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:34.545473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6d6ca18d-b056-40f0-82f5-1d830be925e3 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.282011 Sep 15 04:25:34.550143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 209/441] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:34 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:34.552708 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:34.558303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:34.559520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:34.568421 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.569286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.570378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:34.571087 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:34.579101 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c24b5811-ce1c-4b77-b5b4-98ea0051c748 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1568 microversion: 2.1 time: 0.291451 Sep 15 04:25:34.590250 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 233/442] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:34 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1568 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:34.752635 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:34.762575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:34.769765 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:34.775809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7a70a92f-5649-4673-b377-65a1e44530a2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.224567 Sep 15 04:25:34.776529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 210/443] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:34 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:35.563184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:35.567359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:35.569955 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.570505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.571427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.571905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.596796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:35.597777 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:35.603721 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.604241 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.605084 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.605582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.743944 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:35.752188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e21d9f23-5c8f-4b00-9a39-3f85c4ca4be6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.193885 Sep 15 04:25:35.752897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 234/444] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:35 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:35.788691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:35.795450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:35.796343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:35.797905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ff35db27-6d23-4ad5-b5df-13dd6fdecfd6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1548 microversion: 2.1 time: 0.205468 Sep 15 04:25:35.798714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 211/445] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:35 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1548 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:35.803120 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.803610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.804393 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.804834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.814486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:35.814986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:35.822517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.823204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.824081 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:35.824585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:35.957259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:35.994786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:35.996670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] HTTP exception thrown: Cannot 'detach_volume' instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e while it is in vm_state rescued Sep 15 04:25:35.996930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:35.997411 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Returning 409 to user: Cannot 'detach_volume' instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e while it is in vm_state rescued {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:25:35.998316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4f21889b-c431-4a4c-a742-9ff70e8cbdbd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.206869 Sep 15 04:25:35.998431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-115363d4-88b2-4ac2-af72-41b942dbd9c8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments/72f34da1-3d5a-42b8-a28d-3e5a07ad86dd" status: 409 len: 152 microversion: 2.1 time: 0.188096 Sep 15 04:25:35.998968 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 235/446] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:35 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:25:36.005873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 212/447] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:25:35 2021] DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments/72f34da1-3d5a-42b8-a28d-3e5a07ad86dd => generated 152 bytes in 190 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 15 04:25:36.009039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:36.009039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:36.014220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.014674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.015542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.016597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.088186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-42b303fa-2463-447e-b9f6-38212b5061f6 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action" status: 202 len: 0 microversion: 2.1 time: 0.083871 Sep 15 04:25:36.092203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 236/448] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:25:36 2021] POST /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:25:36.103204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:36.103204 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:36.112587 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.113390 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.116719 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.117281 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.271498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:36.280876 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-40092324-2bcb-4652-9e24-0cef98f85bbc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.187404 Sep 15 04:25:36.282097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 213/449] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:36 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:36.709604 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-ddc51b76-ecba-40d6-8a7d-a3e0de526a8e req-e8c10b2b-0953-4a44-896d-51e1a2f8aab5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "name": "network-vif-plugged", "status": "completed", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:36.711291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:36.711291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:25:36.719435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ddc51b76-ecba-40d6-8a7d-a3e0de526a8e req-e8c10b2b-0953-4a44-896d-51e1a2f8aab5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.719875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ddc51b76-ecba-40d6-8a7d-a3e0de526a8e req-e8c10b2b-0953-4a44-896d-51e1a2f8aab5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.732847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-ddc51b76-ecba-40d6-8a7d-a3e0de526a8e req-e8c10b2b-0953-4a44-896d-51e1a2f8aab5 service nova] Creating event network-vif-plugged:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:25:36.738598 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-ddc51b76-ecba-40d6-8a7d-a3e0de526a8e req-e8c10b2b-0953-4a44-896d-51e1a2f8aab5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Sep 15 04:25:36.739771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 237/450] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:36.770346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:36.771055 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:36.776913 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.777365 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.778146 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:36.778592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:36.915163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:36.923800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e242f853-ef9f-4ee9-9c5d-b6d3c70db393 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.158105 Sep 15 04:25:36.927391 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 214/451] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:36 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:37.018768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:37.019594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:37.026020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.026446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:37.027252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.027686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:37.157093 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:37.165591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:37.167121 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:37.168319 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3c68ada4-219d-48db-964b-0f1f1fdab2af tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.154199 Sep 15 04:25:37.169078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 238/452] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:37 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:37.298844 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:37.299559 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:37.306011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.306676 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:37.307613 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.308157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:37.458536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:37.470136 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fc9fa654-9822-44f8-a681-a92608c734af tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.174820 Sep 15 04:25:37.470722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 215/453] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:37 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:37.946336 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:37.946973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:37.954059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.954508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:37.955329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:37.955765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:38.083235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:38.090547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4adf5129-042f-471b-8ebd-dbc96a5d73ab tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.147886 Sep 15 04:25:38.091303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 239/454] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:37 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:38.191064 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:38.193965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:38.201211 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:38.201997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:38.204036 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:38.204764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:38.332475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:38.341109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:38.342697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:38.345286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-aebffa6b-c8b3-437d-abf0-d001c45a53a3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.160047 Sep 15 04:25:38.346082 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 216/455] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:38 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:38.487463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:38.488099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:38.494419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:38.494891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:38.495755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:38.496197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:38.628032 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:38.636905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-10468a03-aa2b-436e-9e8a-ce984446f2bd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.153366 Sep 15 04:25:38.637578 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 240/456] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:38 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:39.107713 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:39.108324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:39.114670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.115155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.116043 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.116532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.242552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:39.250123 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5a74c14f-da95-47ef-9ab4-65d454694bd9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.145905 Sep 15 04:25:39.250753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 217/457] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:39 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:39.363965 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:39.364560 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:39.370568 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.371012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.371843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.372276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.505028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:39.513838 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:39.515976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:39.517324 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-eef38ad3-1ad7-4f41-8f0a-23646e2c8d67 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.157169 Sep 15 04:25:39.526628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 241/458] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:39 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:39.654681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:39.655325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:39.662080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.662532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.663325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:39.663761 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:39.791932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:39.805975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f2cab34f-dd01-493c-9956-ad37c2110f88 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.154812 Sep 15 04:25:39.806833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 218/459] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:39 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:40.268315 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:40.269164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:40.275354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.275802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.276569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.277001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.405770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:40.417461 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-91ab8f0d-89b0-4e9a-acdb-baa8d834d06e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.153980 Sep 15 04:25:40.418054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 242/460] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:40 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:40.536718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:40.537335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:40.543105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.543585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.544360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.544801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.679863 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:40.690823 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:40.692370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:40.693532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2a9de2be-b860-469f-8b63-9aace997b594 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.162329 Sep 15 04:25:40.694238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 219/461] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:40 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:40.823953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:40.824743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:40.836702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.836702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.836702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:40.836702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:40.965323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:40.987433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d959dffe-2910-4dc3-9890-e2b0326d3615 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.167045 Sep 15 04:25:40.988217 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 243/462] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:40 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:41.434299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:41.435053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:41.444591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:41.445155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:41.446213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:41.446701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:41.576928 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:41.584961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5bbce744-f00f-4720-a5cf-0e80319bf6bd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.154304 Sep 15 04:25:41.585509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 220/463] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:41 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:41.711477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:41.712125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:41.718503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:41.719717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:41.720643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:41.721080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:41.849879 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:41.859317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:41.860961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:41.862158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-962b5742-b404-45e2-b0ee-9e349e55ce99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.154645 Sep 15 04:25:41.862708 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 244/464] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:41 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:42.004503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:42.005444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:42.011660 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.012108 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:42.012886 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.013592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:42.144257 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:42.152233 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-695aa8fd-02c6-42c3-b099-ef294b0b9a21 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.151299 Sep 15 04:25:42.152988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 221/465] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:41 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:42.601558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:42.602170 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:42.609904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.610454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:42.611269 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.611707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:42.748231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:42.755824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-22ab3f73-a86b-4f44-9eae-2fc6ead4e6b7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.157919 Sep 15 04:25:42.756402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 245/466] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:42 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:42.880097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:42.881607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:42.887815 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.888273 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:42.889043 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:42.889478 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:43.013818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:43.023121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:43.024647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:43.025819 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-88a407c4-dfbe-4229-8f42-06fa7ee1d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.149522 Sep 15 04:25:43.026367 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 222/467] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:42 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:43.170516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:43.171168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:43.177212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:43.177663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:43.178440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:43.178874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:43.303761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:43.311619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-42efbbe5-0eff-427d-ad4d-b566b3117d4d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.144821 Sep 15 04:25:43.312768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 246/468] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:43 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:43.772137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:43.772874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:43.778750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:43.779302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:43.780132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:43.780635 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:43.908477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:43.915763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6215bc45-866a-4523-8e9f-9e03e099f90a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.147233 Sep 15 04:25:43.916322 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 223/469] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:43 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:44.044899 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:44.045479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:44.052499 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.052951 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:44.053737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.054174 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:44.178885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:44.188213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:44.189750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:44.190921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bd2f750a-ac0a-43b9-8851-6b4f7dab9274 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.150482 Sep 15 04:25:44.191508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 247/470] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:44 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:44.329785 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:44.330314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:44.336155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.336603 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:44.337365 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.337799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:44.466619 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:44.475602 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-97d72090-ea2d-499f-824f-93e382709f30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.150323 Sep 15 04:25:44.476405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 224/471] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:44 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:44.932641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:44.933247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:44.939372 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.939818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:44.940573 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:44.941057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:45.064724 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:45.071991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-32029bf8-247b-4398-96bc-62b608cca445 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.142900 Sep 15 04:25:45.072551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 248/472] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:44 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:45.209299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:45.209908 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:45.216223 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:45.216679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:45.217471 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:45.217907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:45.338962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:45.348598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:45.350092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:45.351280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-db51d11d-579d-49fd-b6e8-b8c97e0fd354 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.145693 Sep 15 04:25:45.351863 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 225/473] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:45 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:45.493038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:45.494298 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:45.502112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:45.502530 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:45.503630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:45.504477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:45.639366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:45.647793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bd78bb27-caf3-48c5-b0a7-c0629aa62628 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.159195 Sep 15 04:25:45.648379 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 249/474] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:45 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:46.090627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:46.091210 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:46.111660 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.113628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.113628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.113969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.242048 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:46.249922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-17313c0d-60b9-414a-a3d4-6d52c274da6e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.163165 Sep 15 04:25:46.251191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 226/475] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:46 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:46.370577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:46.371484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:46.378737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.379223 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.380000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.380435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.502405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:46.510737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:46.512268 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:46.513421 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-63140035-eab2-44cc-8856-9569b401cbb2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.146832 Sep 15 04:25:46.513983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 250/476] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:46 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:46.665348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:46.665996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:46.672584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.673027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.673780 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:46.674211 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:46.792352 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:46.800406 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8c6a67ef-53cc-4595-baa3-1fc375c414a9 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.139188 Sep 15 04:25:46.800961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 227/477] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:46 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:47.267798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:47.268534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:47.274376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.274827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:47.275628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.276068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:47.452687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:47.459915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f9d84508-2250-4e48-88da-d778d7a886b9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.196642 Sep 15 04:25:47.460475 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 251/478] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:47 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:47.533103 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:47.533913 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:47.539674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.540121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:47.540906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.541331 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:47.727779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:47.738677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:47.740219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:47.741354 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fedca418-132d-4e76-8024-0feab7591cf9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.212531 Sep 15 04:25:47.741941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 228/479] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:47 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:47.817356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:47.817921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:47.823756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.824208 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:47.824988 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:47.825433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:48.240377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:48.248995 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7fa4cfdd-d2af-452f-b238-383116d17e80 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.435317 Sep 15 04:25:48.250212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 252/480] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:47 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:25:48.476430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:48.477046 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:48.482874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:48.483366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:48.485358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:48.485798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:48.602420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:48.610399 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-326e2836-ce17-4093-a963-61f909cd86fd tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1259 microversion: 2.1 time: 0.137467 Sep 15 04:25:48.610968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 229/481] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:48 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1259 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:48.758961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:48.759913 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:48.766013 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:48.766469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:48.768270 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:48.768270 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:48.899621 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:48.909080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:48.910653 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:48.911935 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b139215b-8304-4d64-996e-a3c61e1d021a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.156675 Sep 15 04:25:48.912476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 253/482] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:48 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:49.268157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:49.268693 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:49.274486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.274936 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.275730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.276170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.404206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:49.412544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5b63095e-a15e-4ee4-b56e-8c79479bca7d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1556 microversion: 2.1 time: 0.148985 Sep 15 04:25:49.422383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 230/483] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:49 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:49.628916 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:49.629539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:49.636669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.637409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.638116 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.638586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.773102 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:49.781353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-684329f3-adb1-4bd8-a03b-b3c0553d3b52 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1443 microversion: 2.1 time: 0.157932 Sep 15 04:25:49.781680 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 254/484] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:49 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1443 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:49.797254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:49.797871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:49.803672 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.804125 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.804904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.805343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.922701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:49.929745 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:49.930219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-577131e0-eefe-449c-bec6-f6c618836e59 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1443 microversion: 2.1 time: 0.137017 Sep 15 04:25:49.930549 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:49.930794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 231/485] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:49 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1443 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:49.936908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.937935 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:49.938751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:49.939197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.064547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:50.072670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:50.074158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:50.075330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3883cb67-53da-4533-b531-809918f627ac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.149331 Sep 15 04:25:50.076058 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 255/486] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:49 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:50.429772 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:50.430414 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:50.436083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.436531 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.437585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.438174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.557972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:50.566324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-45a433dd-c7a0-4ea7-b138-0021de1e6ba4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1562 microversion: 2.1 time: 0.140597 Sep 15 04:25:50.566899 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 232/487] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:25:50 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1562 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:25:50.639044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:50.639559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:50.645924 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.646364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.647360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.647797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.777980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lazy-loading 'services' on Instance uuid 76d0ff04-6f6c-469a-b96d-0a01ba58779e {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:25:50.895758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cba65c5c-ee50-4183-9886-4b15acc05b60 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments/72f34da1-3d5a-42b8-a28d-3e5a07ad86dd" status: 202 len: 0 microversion: 2.1 time: 0.260113 Sep 15 04:25:50.899976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 256/488] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:25:50 2021] DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments/72f34da1-3d5a-42b8-a28d-3e5a07ad86dd => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:25:50.905350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:50.906933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:50.917159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.923930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.925091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:50.925634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:50.965663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-adbd4eba-2518-45c3-96fe-de659b637abd tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063858 Sep 15 04:25:50.966336 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 233/489] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:50 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:51.093574 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:51.094207 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:51.100219 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:51.100722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:51.101492 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:51.101927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:51.225969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:51.234843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:51.236431 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:51.237577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-234b6eaa-cd89-4bee-9a7e-653cdb2eafe5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.148320 Sep 15 04:25:51.238128 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 257/490] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:51 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:51.879080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-dbcfbd9c-1633-4fe4-95ac-392a75a34cb5 req-71d747e4-f4ce-4080-a229-054004553495 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:25:51.880637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:25:51.880637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:25:51.887390 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-dbcfbd9c-1633-4fe4-95ac-392a75a34cb5 req-71d747e4-f4ce-4080-a229-054004553495 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:51.887834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-dbcfbd9c-1633-4fe4-95ac-392a75a34cb5 req-71d747e4-f4ce-4080-a229-054004553495 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:51.899287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-dbcfbd9c-1633-4fe4-95ac-392a75a34cb5 req-71d747e4-f4ce-4080-a229-054004553495 service nova] Creating event network-changed:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:25:51.904356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-dbcfbd9c-1633-4fe4-95ac-392a75a34cb5 req-71d747e4-f4ce-4080-a229-054004553495 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029147 Sep 15 04:25:51.908586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 234/491] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:25:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:51.977975 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:51.979071 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:51.986631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:51.987088 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:51.987911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:51.988608 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:52.018464 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a66b22d3-2ffa-4bba-a36f-12c8ddec83b0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044622 Sep 15 04:25:52.019025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 258/492] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:51 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:52.255759 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:52.256383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:52.262622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:52.263088 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:52.263914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:52.264356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:52.394226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:52.402220 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:52.408042 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:52.408042 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-075d2fef-618a-4de5-8085-6db884d7d8b9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.153316 Sep 15 04:25:52.408042 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 235/493] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:52 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:53.029498 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:53.030909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:53.036767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:53.037219 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:53.037983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:53.038418 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:53.066869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-da15354b-5280-45b5-8139-7d350386d11a tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041063 Sep 15 04:25:53.067449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 259/494] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:53 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:53.423063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:53.423698 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:53.429440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:53.429884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:53.430641 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:53.431069 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:53.550608 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:53.559516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:53.561180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:53.563506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d1ccc0fb-fe35-441f-93dc-3cdaaf1e3b42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.144453 Sep 15 04:25:53.564070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 236/495] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:53 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:54.078652 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:54.079613 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:54.085466 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:54.085919 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:54.086686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:54.087123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:54.116225 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3b12d0b5-3ce0-4da7-b133-11f26dcc8090 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041998 Sep 15 04:25:54.116803 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 260/496] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:54 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:54.617916 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:54.618569 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:54.624304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:54.624757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:54.625524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:54.625972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:54.798226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:54.806431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:54.807968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:54.809125 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-84a767cf-589a-48b4-9789-67ea306fbfee tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.195155 Sep 15 04:25:54.809678 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 237/497] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:54 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:55.127059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:55.127990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:55.133971 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:55.134427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:55.135276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:55.135710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:55.167389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c4642bad-616c-40ac-9328-6fb16a09dd3e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Sep 15 04:25:55.167951 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 261/498] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:55 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:55.827546 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:55.828178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:55.834467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:55.834906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:55.835708 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:55.836202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:55.962116 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:55.972074 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:55.974023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:55.975383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-caaa5360-1428-4627-95d8-bef2096279e7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.151760 Sep 15 04:25:55.976006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 238/499] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:55 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:56.180798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:56.181839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:56.188876 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:56.189324 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:56.190140 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:56.190712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:56.221898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0a4df313-42d3-4b0c-b9e4-346e35560a86 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Sep 15 04:25:56.222647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 262/500] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:56 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:56.993969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:56.994626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:57.001009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:57.001456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:57.002237 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:57.002763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:57.123871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:57.132876 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:57.134385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:57.135559 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-de81d74d-cfb2-4e72-b374-684a10eee07b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.145623 Sep 15 04:25:57.136105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 239/501] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:56 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:57.234840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:57.236266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:57.242206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:57.242648 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:57.243446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:57.243872 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:57.272841 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3dc2510e-aba9-4cf9-8b66-1af8d4fe7aab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 Sep 15 04:25:57.273306 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 263/502] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:57 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:58.153729 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:58.154240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:58.160704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:58.161155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:58.161918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:58.162357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:58.284658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:58.285548 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:58.285758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:58.291449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:58.291863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:58.292643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:58.293080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:58.294031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:58.295927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:58.297097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-47dd3869-353e-403b-be50-fc85d36263d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.147153 Sep 15 04:25:58.300934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 240/503] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:58 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:25:58.323235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e50605fc-4c37-44da-8a0b-1d10ea10aad1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Sep 15 04:25:58.323785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 264/504] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:58 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:25:59.316614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:59.317235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:59.323653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:59.324178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:59.325021 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:59.325550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:59.338874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:25:59.340309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:25:59.349468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:59.350241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:59.351303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:25:59.352258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:25:59.387760 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-94e098d1-312c-40de-b7e3-94683e03d9a4 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056778 Sep 15 04:25:59.388340 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 265/505] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:25:59 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:25:59.475422 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:59.483704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:59.485372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:25:59.486532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-61c961dd-4b6a-4f2b-8b11-1df86481d457 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.174544 Sep 15 04:25:59.487083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 241/506] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:25:59 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:00.399663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:00.400578 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:00.406584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.407302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.408220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.408664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.425598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:00.426846 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:00.433965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.434459 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.435319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.435767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.441565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d75d9e89-4e19-402a-8cfb-0dd9500dd4d2 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Sep 15 04:26:00.442233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 266/507] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:00 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:00.504012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:00.504693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:00.510407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.510861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.511703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:00.512151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:00.528089 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lazy-loading 'services' on Instance uuid 95a894d8-561b-4dfb-9240-5df7076fcd2d {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:26:00.652886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:00.663251 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b636ec38-0e42-436f-9789-e5880aafe0a8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments/9658257b-c965-42ff-93aa-476768ba650b" status: 202 len: 0 microversion: 2.1 time: 0.249659 Sep 15 04:26:00.664246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:00.664426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 242/508] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:26:00 2021] DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments/9658257b-c965-42ff-93aa-476768ba650b => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:26:00.667260 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:00.668598 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-dcdf5e30-89dd-4879-8ca5-17e9f128142b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.168380 Sep 15 04:26:00.669690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 267/509] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:00 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:26:01.454977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:01.456090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:01.463203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:01.463710 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:01.464655 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:01.465091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:01.500378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3d24e977-dd3f-4964-99eb-bd74158c2300 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050506 Sep 15 04:26:01.500881 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 243/510] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:01 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:01.687701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:01.688430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:01.694367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:01.695021 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:01.695833 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:01.696264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:01.833623 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:01.842543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:01.845121 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:01.846210 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ab0acca8-1815-4701-8cb3-dc8f08616bf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.163093 Sep 15 04:26:01.849450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 268/511] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:01 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:02.511638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:02.512540 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:02.519571 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:02.520044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:02.520959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:02.521550 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:02.551762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2060779b-2c69-49e7-b99d-7aa552689c6e tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044467 Sep 15 04:26:02.552291 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 244/512] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:02 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:02.864866 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:02.865497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:02.871354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:02.871800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:02.872585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:02.873015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:02.995572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:03.004256 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:03.005738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:03.006881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5ea6a55d-b737-47fe-bb83-8a43c9df9edb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.145705 Sep 15 04:26:03.007471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 269/513] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:02 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:03.316623 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-458658343", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "7a19e811-e680-4643-a0ed-56c0f6d7015b"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:03.367821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] validate_networks() for [('7a19e811-e680-4643-a0ed-56c0f6d7015b', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:26:03.563242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:03.564157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:03.569795 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:03.570239 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:03.571005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:03.571498 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:03.600505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e6259d4a-4fba-4b7f-b66b-f726b4f9c1ab tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042105 Sep 15 04:26:03.601059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 270/514] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:03 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:26:03.707335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:26:03.707837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:26:03.708249 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:26:03.708654 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:26:03.709090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:26:03.717586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:03.718034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:03.718825 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:03.719293 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:03.736725 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Getting quotas for project 3ca5a27e1ff24fdf885395ee6ed8531b. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:26:03.742219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Getting quotas for user fe0e3ce8ae724c5884edcc09234821c1 and project 3ca5a27e1ff24fdf885395ee6ed8531b. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:26:03.753943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:26:03.756242 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:26:03.800651 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-db347702-4b7f-453b-9e5c-f878fc0cde78 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487577 Sep 15 04:26:03.801519 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 245/515] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:26:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:26:03.810998 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fccd1085-caae-42de-915d-8eee8e05bba0 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:03.812128 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fccd1085-caae-42de-915d-8eee8e05bba0 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:03.864266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fccd1085-caae-42de-915d-8eee8e05bba0 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:03.870881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fccd1085-caae-42de-915d-8eee8e05bba0 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1218 microversion: 2.1 time: 0.063633 Sep 15 04:26:03.875569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 271/516] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:03 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:04.025078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:04.025694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:04.031966 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.032431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.033303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.033750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.168391 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:04.177927 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:04.179470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:04.180818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7502a41c-30df-411c-b42e-7ca18e182b9f tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.159459 Sep 15 04:26:04.181372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 246/517] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:04 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:04.611970 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:04.612853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:04.618682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.619122 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.619901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.620328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.649252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-eb72c601-4275-4e33-8c2e-7a90f2cf2cad tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041678 Sep 15 04:26:04.650006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 272/518] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:04 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:04.888864 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:04.889983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:04.895993 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.897636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.898697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:04.899274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:04.965960 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:04.974223 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-53efb7a2-8fb8-41c4-a030-72583e38c571 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1276 microversion: 2.1 time: 0.088964 Sep 15 04:26:04.974793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 247/519] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:04 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:05.199476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:05.200028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:05.205921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:05.206373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:05.207165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:05.207610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:05.373146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:05.381792 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:05.383321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:05.384487 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2c74f42f-c2a3-4ac6-ae84-201df928235d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.188804 Sep 15 04:26:05.385049 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 273/520] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:05 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:05.662027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:05.662996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:05.668956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:05.669396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:05.670162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:05.670810 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:05.700219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a29c459f-b831-44c9-819d-e8d0205b805d tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042452 Sep 15 04:26:05.700686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 248/521] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:05 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:05.992189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:05.993187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:06.010630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.011214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.012409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.012948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.124558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-0c0681e3-7a81-42db-bb84-c9bf249eba1f req-d1fef90b-178e-416b-b8f7-d7537865df60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58a6345d-62f1-4c60-99ac-3d2d9deaa1c2", "tag": "db19f83c-8fe9-41cf-808c-6709c58d6e89"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:06.126639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:26:06.126639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:26:06.133800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0c0681e3-7a81-42db-bb84-c9bf249eba1f req-d1fef90b-178e-416b-b8f7-d7537865df60 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.134319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0c0681e3-7a81-42db-bb84-c9bf249eba1f req-d1fef90b-178e-416b-b8f7-d7537865df60 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.146866 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-0c0681e3-7a81-42db-bb84-c9bf249eba1f req-d1fef90b-178e-416b-b8f7-d7537865df60 service nova] Creating event network-changed:db19f83c-8fe9-41cf-808c-6709c58d6e89 for instance 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 on hv-cinder-76015 Sep 15 04:26:06.151639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-0c0681e3-7a81-42db-bb84-c9bf249eba1f req-d1fef90b-178e-416b-b8f7-d7537865df60 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Sep 15 04:26:06.152405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 249/522] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:26:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:26:06.230541 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:06.238382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e1d04b92-c75b-48ca-b23f-53af5c345e65 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.250359 Sep 15 04:26:06.238949 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 274/523] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:05 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:06.403560 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:06.404548 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:06.411219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.411871 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.412803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.413239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.604995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:06.613922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:06.615446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:06.616601 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-437867cf-acf1-4525-91ca-2ced24bea30a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.217329 Sep 15 04:26:06.617167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 250/524] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:06 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:06.711703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:06.712612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:06.719272 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.719725 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.720503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:06.720940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:06.750359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ffedb705-f857-45d1-8d0c-1edcb6bd6c30 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042339 Sep 15 04:26:06.750928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 275/525] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:06 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:07.255822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:07.256440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:07.262118 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.262564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.263352 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.263787 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.380514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:07.387688 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6766e7a9-61d1-435b-a485-f07014f8a03a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.135519 Sep 15 04:26:07.388281 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 251/526] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:07 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:07.634383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:07.634909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:07.640771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.641217 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.641975 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.642411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.759275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:07.761537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:07.762444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:07.768302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.768750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.769329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:07.769513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:07.769949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:07.770825 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:07.772018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b0f7f716-7426-4fec-8b87-74504785ff1c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.141426 Sep 15 04:26:07.772607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 276/527] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:07 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:07.798592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-048d25c3-1bd1-4a73-8e5c-3b2196a16251 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040727 Sep 15 04:26:07.799137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 252/528] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:07 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:26:08.404679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:08.405793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:08.411691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.412141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.412903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.413333 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.744324 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:08.751396 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-59898a16-e4e3-4e02-ac66-835db5eec257 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.350360 Sep 15 04:26:08.751960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 277/529] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:08 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:08.789820 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:08.790435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:08.796906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.797358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.798133 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.798572 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.810118 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:08.811036 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:08.817126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.817659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.818451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:08.818891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:08.850078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-513c90c3-0448-4adc-830e-59bf61ed0428 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043729 Sep 15 04:26:08.852189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 278/530] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:08 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:26:08.923810 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:08.932740 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:08.934226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:08.935398 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-135a2803-f1e1-4155-9e40-0e7b6bc0bd94 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.149349 Sep 15 04:26:08.935968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 253/531] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:08 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:09.767775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:09.768382 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:09.774094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.774535 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:09.775318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.775747 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:09.862875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:09.864057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:09.870086 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.870799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:09.871822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.872448 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:09.900353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:09.906102 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b37366ca-cb36-460a-a6eb-872f9bff1e94 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048118 Sep 15 04:26:09.906670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 254/532] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:26:09 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:26:09.908425 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1170cf3b-5a04-412a-92e7-8af11705cce7 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.144871 Sep 15 04:26:09.909055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 279/533] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:09 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:09.956930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:09.956930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:09.960680 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.961207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:09.962323 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:09.974566 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:10.091860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:10.100045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:10.101546 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:10.102707 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-75ac2a85-39e2-42f8-b946-e59edb2373eb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.152804 Sep 15 04:26:10.103293 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 255/534] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:09 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:10.925989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:10.926720 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:10.932701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:10.933149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:10.933913 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:10.934341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:10.978493 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-78c6f337-b43c-49f9-ace3-759db5419d71 req-73c8af5e-5fb2-4968-bc1f-7cd797f259e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6345d-62f1-4c60-99ac-3d2d9deaa1c2", "name": "network-vif-plugged", "status": "completed", "tag": "db19f83c-8fe9-41cf-808c-6709c58d6e89"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:10.980105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:26:10.980105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:26:10.987173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-78c6f337-b43c-49f9-ace3-759db5419d71 req-73c8af5e-5fb2-4968-bc1f-7cd797f259e8 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:10.987890 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-78c6f337-b43c-49f9-ace3-759db5419d71 req-73c8af5e-5fb2-4968-bc1f-7cd797f259e8 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.013644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-78c6f337-b43c-49f9-ace3-759db5419d71 req-73c8af5e-5fb2-4968-bc1f-7cd797f259e8 service nova] Creating event network-vif-plugged:db19f83c-8fe9-41cf-808c-6709c58d6e89 for instance 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 on hv-cinder-76015 Sep 15 04:26:11.020494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-78c6f337-b43c-49f9-ace3-759db5419d71 req-73c8af5e-5fb2-4968-bc1f-7cd797f259e8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045627 Sep 15 04:26:11.021441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 256/535] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:26:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:26:11.066158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:11.074255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5089aee0-2a3c-40aa-ad7f-975993e12994 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.152460 Sep 15 04:26:11.074953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 280/536] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:10 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:11.124756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:11.126132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:11.133448 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:11.133679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.134583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:11.135025 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.309483 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-512120d1-0292-47f0-9f73-1ce40ea7599c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:11.314084 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:11.317269 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-512120d1-0292-47f0-9f73-1ce40ea7599c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:11.318249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-512120d1-0292-47f0-9f73-1ce40ea7599c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.323501 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:11.325277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:11.327590 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e95f4126-4b13-4a05-993e-a89890c5a181 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.208452 Sep 15 04:26:11.328634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 257/537] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:11 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:11.381178 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-512120d1-0292-47f0-9f73-1ce40ea7599c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Going to try to stop instance {{(pid=108182) force_stop /opt/stack/nova/nova/compute/api.py:2652}} Sep 15 04:26:11.427174 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-512120d1-0292-47f0-9f73-1ce40ea7599c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 202 len: 0 microversion: 2.1 time: 0.121164 Sep 15 04:26:11.427764 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 281/538] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:26:11 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:26:11.435790 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:11.436468 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:11.442622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:11.443076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.443891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:11.444332 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:11.568684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:11.575901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b5c2d6ab-60d2-49e6-bc90-5ec9bf35c0dc tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.143686 Sep 15 04:26:11.576458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 258/539] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:11 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:12.094279 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:12.094975 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:12.101083 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.101546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.102321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.102759 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.222435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.229607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2d3cdf02-88e2-463a-af41-5d85e084bc22 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1318 microversion: 2.1 time: 0.140047 Sep 15 04:26:12.230165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 282/540] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:12 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:12.251187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:12.251704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:12.257369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.257815 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.258575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.259015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.283958 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:26:12.346699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:12.347502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:12.355020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.355490 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.356418 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.356673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0a48821e-0726-4ad8-8251-8097ae8c0620 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "DELETE /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 204 len: 0 microversion: 2.1 time: 0.108861 Sep 15 04:26:12.356856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.357528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 259/541] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:26:12 2021] DELETE /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:26:12.366314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:12.367011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:12.372691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.373149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.374000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.374602 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.544381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.549458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.553281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.554769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.555951 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8a4de294-b667-4486-ba1c-c48354f590e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.214022 Sep 15 04:26:12.556506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 283/542] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:12 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:26:12.556959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f22f8a34-4845-40b6-ad8e-1619c31ca8d0 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1508 microversion: 2.1 time: 0.194730 Sep 15 04:26:12.557677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 260/543] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:12 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:12.594264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:12.594862 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:12.600659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.601036 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.601900 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:12.602480 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:12.731496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:12.739765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5213a01f-c9b8-4086-8c7c-943856f4d21b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.148888 Sep 15 04:26:12.740998 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 284/544] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:12 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:13.035925 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-0ac74095-2a65-45ea-802a-576508d4808b req-cf6f214c-fa73-4630-b4aa-c5883dfa302a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "name": "network-vif-plugged", "status": "completed", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:13.037506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:26:13.037506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:26:13.044476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0ac74095-2a65-45ea-802a-576508d4808b req-cf6f214c-fa73-4630-b4aa-c5883dfa302a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.044934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0ac74095-2a65-45ea-802a-576508d4808b req-cf6f214c-fa73-4630-b4aa-c5883dfa302a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.056568 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-0ac74095-2a65-45ea-802a-576508d4808b req-cf6f214c-fa73-4630-b4aa-c5883dfa302a service nova] Creating event network-vif-plugged:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:26:13.062787 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-0ac74095-2a65-45ea-802a-576508d4808b req-cf6f214c-fa73-4630-b4aa-c5883dfa302a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029055 Sep 15 04:26:13.063381 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 261/545] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:13.245771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:13.246408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:13.252671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.253110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.253862 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.254292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.372177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.379578 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-63bdaa55-68cd-4dcd-92a4-dccfc0b94229 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1508 microversion: 2.1 time: 0.137405 Sep 15 04:26:13.380142 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 285/546] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:13 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1508 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:13.573972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:13.574296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:13.574745 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:13.575227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:13.581151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.581599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.582393 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.582601 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.582822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.583186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.584001 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.584624 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.813922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.825921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-581d8451-cf20-4815-b0d2-f21762b93ae1 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1508 microversion: 2.1 time: 0.255371 Sep 15 04:26:13.827123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 286/547] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:13 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:13.830094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.832597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:13.833378 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:13.839579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.840066 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.840855 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:13.841021 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.841297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:13.843180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.844530 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2fe85e3e-b51d-4a71-a766-245800870814 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.274256 Sep 15 04:26:13.845396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 262/548] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:13 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:13.968381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:13.976060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b2a38aa5-801a-4761-8af5-b4d3138a18a2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.147452 Sep 15 04:26:13.976796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 287/549] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:13 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:14.847045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:14.847758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:14.853474 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:14.853850 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:14.854607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:14.855038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:14.862370 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:14.862964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:14.868804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:14.869251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:14.870022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:14.870494 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:15.041966 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:15.044992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:15.050947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:15.052593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:15.052756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ad830c9b-aa5b-4692-b24a-d2c0e93d42ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1508 microversion: 2.1 time: 0.209705 Sep 15 04:26:15.053193 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 263/550] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:14 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:15.053882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-82f3ed60-1425-447b-9c5e-29b333fed219 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.196115 Sep 15 04:26:15.054599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 288/551] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:14 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:26:15.063221 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:15.063221 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:15.068385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:15.068921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:15.069783 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:15.070285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:15.191880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:15.198995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-442a4aeb-69b0-4184-9a77-1dbc28ba0246 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.144874 Sep 15 04:26:15.199578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 264/552] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:15 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:16.071184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:16.071860 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:16.072247 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:16.073343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:16.077711 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.078868 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.079750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.080190 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.080734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.081215 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.081991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.082578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.340339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:16.347876 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cded8b23-6f60-4aba-bd26-c61260ae04e7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 200 len: 1508 microversion: 2.1 time: 0.280417 Sep 15 04:26:16.348449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 289/553] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:16 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 1508 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:16.353167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:16.353458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:16.354237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:16.360529 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.361068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.362945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.362945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.363585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:16.365187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:16.366537 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fb3561be-ed63-4f32-b371-c8bb40add734 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1810 microversion: 2.20 time: 0.297911 Sep 15 04:26:16.367317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 265/554] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:16 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1810 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:26:16.598840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:16.606000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-398e407c-0b53-4062-88a3-5f01aa349940 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.256439 Sep 15 04:26:16.614833 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 290/555] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:16 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:16.759079 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-800e76c2-aad9-4f52-9eb6-fa897e38f62e req-9db4dd23-cba3-44d6-85e1-600ca41d71af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faf84e01-9ef8-4f6e-95b7-118c0e68eb71", "name": "network-vif-deleted", "tag": "b0ed4920-f031-4c30-8129-6e8e39e547fb"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:16.760717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:26:16.760717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:26:16.768018 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-800e76c2-aad9-4f52-9eb6-fa897e38f62e req-9db4dd23-cba3-44d6-85e1-600ca41d71af service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:16.768462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-800e76c2-aad9-4f52-9eb6-fa897e38f62e req-9db4dd23-cba3-44d6-85e1-600ca41d71af service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:16.779961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-800e76c2-aad9-4f52-9eb6-fa897e38f62e req-9db4dd23-cba3-44d6-85e1-600ca41d71af service nova] Creating event network-vif-deleted:b0ed4920-f031-4c30-8129-6e8e39e547fb for instance faf84e01-9ef8-4f6e-95b7-118c0e68eb71 on hv-cinder-76015 Sep 15 04:26:16.785114 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-800e76c2-aad9-4f52-9eb6-fa897e38f62e req-9db4dd23-cba3-44d6-85e1-600ca41d71af service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029582 Sep 15 04:26:16.785703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 266/556] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:26:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:17.365321 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:17.365922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: faf84e01-9ef8-4f6e-95b7-118c0e68eb71] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:17.372231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.372787 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.373864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.374440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.385936 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:17.386788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:17.389591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] HTTP exception thrown: Instance faf84e01-9ef8-4f6e-95b7-118c0e68eb71 could not be found. Sep 15 04:26:17.390781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Returning 404 to user: Instance faf84e01-9ef8-4f6e-95b7-118c0e68eb71 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:26:17.392366 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-196ff9d4-026d-4be3-b84b-3b13324fd5a8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71" status: 404 len: 111 microversion: 2.1 time: 0.030796 Sep 15 04:26:17.393114 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 291/557] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:17 2021] GET /compute/v2.1/servers/faf84e01-9ef8-4f6e-95b7-118c0e68eb71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:26:17.395538 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.396206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.397184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.397904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.400688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:17.401375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:17.407718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.408397 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.409390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.410070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.436877 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:26:17.523268 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:17.528644 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-910d0a4e-ef7a-4e10-ab56-3eb32d3cfc74 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 204 len: 0 microversion: 2.1 time: 0.131140 Sep 15 04:26:17.529400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 292/558] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:26:17 2021] DELETE /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:26:17.538782 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:17.539043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:17.539843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:17.541510 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:17.542705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-39f626aa-239f-46a2-891c-9689c6b467d3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1797 microversion: 2.20 time: 0.161245 Sep 15 04:26:17.543296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 267/559] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:26:17 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1797 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:26:17.550121 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.550574 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.551386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.551830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.623564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:17.624176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:17.630131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.630583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.631384 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:17.631822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:17.684135 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:17.692560 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0753dcb6-ace0-4abd-8fba-3f67757aeb11 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.157886 Sep 15 04:26:17.693207 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 293/560] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:17 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:17.766819 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:17.774171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c4d54673-04d2-42cf-a5aa-6bbf2af78598 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.154129 Sep 15 04:26:17.774677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 268/561] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:17 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:18.709189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:18.709836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:18.715534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:18.715983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:18.716751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:18.717184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:18.791265 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:18.791902 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:18.798522 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:18.798965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:18.799758 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:18.800196 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:18.848536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:18.855778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bd870a0f-997d-466d-bc62-b381d7639af3 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.150226 Sep 15 04:26:18.856327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 294/562] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:18 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:18.924585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:18.931803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f3bc55bd-03d4-43a6-9010-1aa266602361 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.144328 Sep 15 04:26:18.932370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 269/563] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:18 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:19.872988 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:19.873687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:19.880596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:19.881055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:19.881840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:19.882329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:19.948840 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:19.949462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:19.956324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:19.957018 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:19.957821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:19.958262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:20.032565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:20.040071 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-606df6ff-dfbf-4967-a2f6-ed71c452b6cc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.170736 Sep 15 04:26:20.040645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 295/564] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:19 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:20.095417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:20.103426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-989f043e-9390-4e7b-a935-3c7b9f8d3345 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.158167 Sep 15 04:26:20.104231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 270/565] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:19 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:21.057426 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:21.058030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:21.064638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:21.065085 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:21.065849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:21.066281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:21.121988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:21.122609 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:21.129817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:21.130271 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:21.131049 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:21.131565 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:21.217904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:21.225149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e3332286-bfb3-4681-aac2-e1102b2c4897 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.171349 Sep 15 04:26:21.225715 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 296/566] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:21 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:21.274760 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:21.282129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ab0d705c-115f-45f2-8ad6-b580554219ee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.164744 Sep 15 04:26:21.282687 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 271/567] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:21 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:22.241405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:22.242013 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:22.247752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:22.248201 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:22.248969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:22.249918 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:22.299516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:22.300134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:22.306200 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:22.306657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:22.307554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:22.308000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:22.398007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:22.405338 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c9ae0b45-8b27-4586-89e5-4973cd004bb8 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.167546 Sep 15 04:26:22.413749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 297/568] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:22 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:22.454407 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:22.461699 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a9883154-82d5-42f3-9cbb-317d50edfc8d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.166437 Sep 15 04:26:22.462257 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 272/569] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:22 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:23.422772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:23.423428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:23.429340 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:23.429791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:23.430601 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:23.431039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:23.478554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:23.479229 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:23.485059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:23.485509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:23.486280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:23.486720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:23.586018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:23.593992 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a05a8742-8110-4e37-854f-ced6a82233ed tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.174944 Sep 15 04:26:23.594584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 298/570] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:23 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:23.633802 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:23.641473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9a974d44-1786-4fd8-9ef6-4567f1748999 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.166619 Sep 15 04:26:23.642023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 273/571] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:23 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:24.610903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:24.611493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:24.617311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:24.617793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:24.618629 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:24.619069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:24.658682 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:24.659372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:24.665290 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:24.665743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:24.666606 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:24.667124 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:24.912294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '304734511d4f4c85af12772a26505629', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774cd86cad2f4d7a9ebe2a9ff8223570', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:24.919637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:24.919811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6739ab78-408a-4a83-b0b0-ed98b6f66da7 tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 200 len: 1522 microversion: 2.1 time: 0.313186 Sep 15 04:26:24.920309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 299/572] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:24 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:24.936439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-50f1b8c6-d8f0-4c2d-80ec-3a0c1e3871ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.282075 Sep 15 04:26:24.937059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 274/573] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:24 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:25.210972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-9d3a8e50-dffa-4f9b-9b31-faa1124a21ec req-ee9e3987-afa3-4ae1-8bfa-6b7e88872975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76d0ff04-6f6c-469a-b96d-0a01ba58779e", "name": "network-vif-deleted", "tag": "0fba4829-f68e-4f8d-baae-e9f6e4cebcab"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:25.212847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:26:25.212847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:26:25.220055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9d3a8e50-dffa-4f9b-9b31-faa1124a21ec req-ee9e3987-afa3-4ae1-8bfa-6b7e88872975 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:25.220503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9d3a8e50-dffa-4f9b-9b31-faa1124a21ec req-ee9e3987-afa3-4ae1-8bfa-6b7e88872975 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:25.232075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-9d3a8e50-dffa-4f9b-9b31-faa1124a21ec req-ee9e3987-afa3-4ae1-8bfa-6b7e88872975 service nova] Creating event network-vif-deleted:0fba4829-f68e-4f8d-baae-e9f6e4cebcab for instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e on hv-cinder-76015 Sep 15 04:26:25.241255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-9d3a8e50-dffa-4f9b-9b31-faa1124a21ec req-ee9e3987-afa3-4ae1-8bfa-6b7e88872975 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033833 Sep 15 04:26:25.241921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 300/574] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:26:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:25.936824 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:25.937631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] [instance: 76d0ff04-6f6c-469a-b96d-0a01ba58779e] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:25.944348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:25.944822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:25.945649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:25.946125 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:25.955439 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:25.956360 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:25.962389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] HTTP exception thrown: Instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e could not be found. Sep 15 04:26:25.962992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] Returning 404 to user: Instance 76d0ff04-6f6c-469a-b96d-0a01ba58779e could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:26:25.963617 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:25.963852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ca0eb786-cc39-4b5d-9242-3a49e14259dc tempest-ServerRescueNegativeTestJSON-1994994648 tempest-ServerRescueNegativeTestJSON-1994994648-project] 10.222.0.37 "GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e" status: 404 len: 111 microversion: 2.1 time: 0.030846 Sep 15 04:26:25.964136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:25.964401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 275/575] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:25 2021] GET /compute/v2.1/servers/76d0ff04-6f6c-469a-b96d-0a01ba58779e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:26:25.965004 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:25.965689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:26.106323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:26.113852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-40e1c9fb-d9ae-4ed5-95af-ce22fd41f2b0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1679 microversion: 2.1 time: 0.163141 Sep 15 04:26:26.114455 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 301/576] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:25 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:26:27.132230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:27.132837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:27.138518 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:27.138963 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:27.139796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:27.140232 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:27.270579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:27.278090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cffe69c9-6658-4fc9-a02d-ced83291dd59 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1656 microversion: 2.1 time: 0.150223 Sep 15 04:26:27.278651 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 276/577] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:27 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1656 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:27.294054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4a453698-0ec8-4d22-9036-7a3d6ac9e141 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:27.300585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a453698-0ec8-4d22-9036-7a3d6ac9e141 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:27.301043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a453698-0ec8-4d22-9036-7a3d6ac9e141 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:27.323920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4a453698-0ec8-4d22-9036-7a3d6ac9e141 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Going to try to start instance {{(pid=108182) start /opt/stack/nova/nova/compute/api.py:2675}} Sep 15 04:26:27.371233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4a453698-0ec8-4d22-9036-7a3d6ac9e141 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action" status: 202 len: 0 microversion: 2.1 time: 0.080551 Sep 15 04:26:27.371846 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 302/578] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:26:27 2021] POST /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:26:27.381224 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:27.382101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:27.388808 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:27.389262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:27.390194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:27.390738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:27.595796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:27.604447 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-95526c3e-733b-4edb-a719-1aa90ab80f0a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1665 microversion: 2.1 time: 0.227790 Sep 15 04:26:27.605155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 277/579] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:27 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1665 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:28.662380 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:28.662997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:28.669574 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:28.670033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:28.670831 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:28.671347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:28.808864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:28.819541 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e600ec23-ebb7-47ce-826f-8db9e056b8db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1665 microversion: 2.1 time: 0.161332 Sep 15 04:26:28.820320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 303/580] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:28 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1665 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:29.837080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:29.837795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:29.843513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:29.844064 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:29.844870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:29.845462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:29.968588 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:26:29.976769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a3288314-f5cd-4aae-990b-7df032702d91 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1669 microversion: 2.1 time: 0.143257 Sep 15 04:26:29.977346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 278/581] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:26:29 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1669 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:26:33.866072 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "347b330d-7b41-4bdf-898d-78a64b129720", "device": "/dev/sdb"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:26:33.867793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:33.873842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:33.874380 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:33.875169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:33.875620 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:34.117997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-56d104e4-54e3-47a8-bab4-44ddcba61c29 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "POST /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255579 Sep 15 04:26:34.118649 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 304/582] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:26:33 2021] POST /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:26:59.713256 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:26:59.713837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:26:59.719818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:59.720396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:59.721272 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:26:59.721813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:26:59.806115 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lazy-loading 'services' on Instance uuid 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:26:59.871723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4610ee76-926b-4d00-b592-e58d1519a6f1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "DELETE /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2/os-volume_attachments/347b330d-7b41-4bdf-898d-78a64b129720" status: 202 len: 0 microversion: 2.1 time: 0.162066 Sep 15 04:26:59.872301 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 279/583] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:26:59 2021] DELETE /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2/os-volume_attachments/347b330d-7b41-4bdf-898d-78a64b129720 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:27:00.995204 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:00.995791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:01.002559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:01.003011 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:01.003807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:01.004247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:01.028006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:27:01.100329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bf63313f-2c74-4984-91c2-6a51100bcc2f tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "DELETE /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 204 len: 0 microversion: 2.1 time: 0.109433 Sep 15 04:27:01.100908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 305/584] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:27:00 2021] DELETE /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:27:01.109404 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:01.110091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:01.117133 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:01.117580 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:01.118337 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:01.118768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:01.237254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:01.245022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9fb98438-0c9c-469a-8692-47017c72bb81 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1514 microversion: 2.1 time: 0.139616 Sep 15 04:27:01.245584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 280/585] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:01 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1514 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:02.262180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:02.263015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:02.268768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:02.269301 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:02.270186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:02.270767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:02.461163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:02.469245 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cd603446-ec76-42d0-8308-39b9ee1a1c53 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1514 microversion: 2.1 time: 0.211134 Sep 15 04:27:02.469805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 306/586] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:02 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1514 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:03.283648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-9885c3e0-e0f9-4c99-a9c2-55832b365d8c req-d219f6b6-f329-4368-98d1-a8650a96039c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58a6345d-62f1-4c60-99ac-3d2d9deaa1c2", "name": "network-vif-deleted", "tag": "db19f83c-8fe9-41cf-808c-6709c58d6e89"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:03.285243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:03.285243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:03.292124 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-9885c3e0-e0f9-4c99-a9c2-55832b365d8c req-d219f6b6-f329-4368-98d1-a8650a96039c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:03.292558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-9885c3e0-e0f9-4c99-a9c2-55832b365d8c req-d219f6b6-f329-4368-98d1-a8650a96039c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:03.304630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-9885c3e0-e0f9-4c99-a9c2-55832b365d8c req-d219f6b6-f329-4368-98d1-a8650a96039c service nova] Creating event network-vif-deleted:db19f83c-8fe9-41cf-808c-6709c58d6e89 for instance 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 on hv-cinder-76015 Sep 15 04:27:03.309376 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-9885c3e0-e0f9-4c99-a9c2-55832b365d8c req-d219f6b6-f329-4368-98d1-a8650a96039c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030053 Sep 15 04:27:03.309959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 281/587] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:03.485539 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:03.486180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:03.492394 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:03.492838 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:03.493602 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:03.494035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:03.524769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:03.525251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:03.525717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lazy-loading 'fault' on Instance uuid 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:27:03.567569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:03.574941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-03ae293c-9400-4840-96f4-bd85a527989e tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 200 len: 1308 microversion: 2.1 time: 0.092940 Sep 15 04:27:03.575616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 307/588] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:03 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:04.593607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:04.594297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:04.600818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:04.601297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:04.602122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:04.602644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:04.616489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] HTTP exception thrown: Instance 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 could not be found. Sep 15 04:27:04.617169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Returning 404 to user: Instance 58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:27:04.618155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-156ddb2b-baf3-4e71-916c-35f885a75770 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2" status: 404 len: 111 microversion: 2.1 time: 0.029034 Sep 15 04:27:04.618762 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 282/589] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:04 2021] GET /compute/v2.1/servers/58a6345d-62f1-4c60-99ac-3d2d9deaa1c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:27:10.916111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:10.916671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:10.922881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:10.923358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:10.924125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:10.924563 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:10.953265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-83bdc885-3d13-4752-806e-fc9aee2d55bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments/7cb372d5-bdf2-4b5f-aa5d-0d5575d801ae" status: 200 len: 194 microversion: 2.20 time: 0.040929 Sep 15 04:27:10.953824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 308/590] 10.222.0.37 () {60 vars in 1454 bytes} [Wed Sep 15 04:27:10 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments/7cb372d5-bdf2-4b5f-aa5d-0d5575d801ae => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:27:11.019750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:11.020396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:11.026169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:11.026611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:11.027412 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:11.027943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:11.123440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lazy-loading 'services' on Instance uuid 9af1a4f0-8870-46fa-8b33-7b855766dda3 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:27:11.190454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-db05cdc7-d760-4e68-8ae3-ebd5db590251 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments/7cb372d5-bdf2-4b5f-aa5d-0d5575d801ae" status: 202 len: 0 microversion: 2.20 time: 0.174298 Sep 15 04:27:11.191397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 283/591] 10.222.0.37 () {60 vars in 1457 bytes} [Wed Sep 15 04:27:11 2021] DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments/7cb372d5-bdf2-4b5f-aa5d-0d5575d801ae => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:27:11.199977 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:11.201465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:11.207309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:11.208569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:11.209409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:11.209952 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:11.241402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-147b03ae-c85d-45ae-b8c7-162bb9312e40 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045231 Sep 15 04:27:11.242135 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 309/592] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:11 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:12.253823 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:12.255470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:12.261492 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:12.261941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:12.262704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:12.263153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:12.291632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ea11a486-d35a-4851-a682-3456b87b2fac tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041891 Sep 15 04:27:12.292361 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 284/593] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:12 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:27:13.303120 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:13.304237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:13.310134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:13.310579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:13.311378 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:13.311814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:13.343275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ed9103ad-c199-42b8-a715-4ac795616a2a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043893 Sep 15 04:27:13.343828 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 310/594] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:13 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:14.352031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c53fce22-80e2-49aa-b404-b77df44dc0dc] AMQP server on 10.222.0.37:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 15 04:27:14.355786 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:14.356812 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:14.365153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.365153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.365153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.365153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.392317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-908b4c8b-bfc5-499e-b36e-6ce11b1aac11 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041707 Sep 15 04:27:14.392917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 285/595] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:14 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:14.528080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:14.528991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:14.534911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.535943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.536796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.537241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.565976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6f6d5dc6-a770-4e17-a204-2bbf8f1f85e5 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041662 Sep 15 04:27:14.566512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 311/596] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:27:14 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:27:14.627364 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:14.627861 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:14.634084 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.634533 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.635340 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.635779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.659439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:27:14.735227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3a36fd63-cc46-4db9-a499-351316aa9b42 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 204 len: 0 microversion: 2.1 time: 0.110725 Sep 15 04:27:14.735606 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 286/597] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:27:14 2021] DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:27:14.745902 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:14.746521 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:14.752303 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.752756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.753536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:14.753976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:14.873183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:14.880463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-28ceeb81-0455-405e-98cf-057958c91898 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.138420 Sep 15 04:27:14.881038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 312/598] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:14 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:15.405414 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:15.406557 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:15.424100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.424554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.425335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.425776 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.431061 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [-] [c53fce22-80e2-49aa-b404-b77df44dc0dc] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 46758. Sep 15 04:27:15.457060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d46c4693-92af-451b-89ed-8e91058e1179 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055413 Sep 15 04:27:15.457959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 287/599] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:15 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:15.485465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1581829325", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "7a19e811-e680-4643-a0ed-56c0f6d7015b"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:15.535735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] validate_networks() for [('7a19e811-e680-4643-a0ed-56c0f6d7015b', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:27:15.875675 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:27:15.876107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:27:15.876577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:27:15.876985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:27:15.877397 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:27:15.886416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.886864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.887699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.888134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.897792 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:15.898402 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:15.904070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.904524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.905296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:15.905733 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:15.907221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Getting quotas for project 3ca5a27e1ff24fdf885395ee6ed8531b. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:15.911173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Getting quotas for user fe0e3ce8ae724c5884edcc09234821c1 and project 3ca5a27e1ff24fdf885395ee6ed8531b. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:15.921551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:27:15.923871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:27:15.969585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-621efcf6-32a3-4c6a-aacf-9f61b26280e1 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487702 Sep 15 04:27:15.970492 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 313/600] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:27:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:27:15.981171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-38e8f607-9595-474b-9b4d-8be08861e666 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:15.981967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-38e8f607-9595-474b-9b4d-8be08861e666 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:16.067242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-38e8f607-9595-474b-9b4d-8be08861e666 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:16.073869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-38e8f607-9595-474b-9b4d-8be08861e666 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1219 microversion: 2.1 time: 0.097308 Sep 15 04:27:16.074771 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 314/601] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:15 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:16.087219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:16.094665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b2c1d318-1239-4330-9dcd-1cb6301bea79 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.201056 Sep 15 04:27:16.099968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 288/602] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:15 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:16.468584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:16.469596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:16.476645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:16.477095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:16.477867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:16.478305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:16.506202 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d48045aa-6f89-4d42-8d61-e7b98aa85acc tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041441 Sep 15 04:27:16.506743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 315/603] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:16 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:17.090460 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:17.091027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:17.096897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.097343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.098588 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.099033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.112008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:17.112615 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:17.118230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.118675 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.119463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.119902 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.161386 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:17.168786 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f6874c0d-57ed-4112-bd42-ddfec771d337 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1223 microversion: 2.1 time: 0.081965 Sep 15 04:27:17.169359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 289/604] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:17 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:17.246247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:17.253401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bf10881c-9644-4fde-91a2-2dd7c0b3ff50 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.145061 Sep 15 04:27:17.253960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 316/605] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:17 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:17.517479 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:17.518606 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:17.525958 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.526472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.527278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:17.527719 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:17.556515 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ce5a7cab-aa52-4efc-b10a-f43b57099fa3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043243 Sep 15 04:27:17.557058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 290/606] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:17 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:18.186281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:18.187008 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:18.193534 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.194018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.194979 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.195434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.266136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:18.270985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:18.271816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:18.273503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-26290f7d-1cff-43db-b4c4-89e5daf4dd71 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1277 microversion: 2.1 time: 0.090946 Sep 15 04:27:18.274068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 317/607] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:18 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:18.287757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.288285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.289157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.289698 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.498490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:18.505868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-20310af3-924d-4b9d-a238-42a5a5cbfa65 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.238567 Sep 15 04:27:18.506448 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 291/608] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:18 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:18.567896 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:18.568870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:18.574917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.575393 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.576167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.576600 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.605660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-19e90250-4f46-468a-8615-c175c8733dad tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041661 Sep 15 04:27:18.606234 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 318/609] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:27:18 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:18.668458 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:18.668961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:18.674664 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.675169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.675943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.676384 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.702424 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:27:18.780446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7a449c11-f9a4-4de8-b2b1-35041ce9d86c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 204 len: 0 microversion: 2.20 time: 0.115283 Sep 15 04:27:18.780940 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 292/610] 10.222.0.37 () {60 vars in 1280 bytes} [Wed Sep 15 04:27:18 2021] DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 04:27:18.790197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:18.790837 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:18.796538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.796987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.797751 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:18.798188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:18.916079 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:18.923759 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:18.925254 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:18.926405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4a4ebb46-14ac-4601-9bc1-757b33a7b07a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.140725 Sep 15 04:27:18.926986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 319/611] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:18 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:19.290673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:19.291398 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:19.297299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.297799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:19.298518 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.298959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:19.416851 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:19.424057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-68b487a7-28e5-49d2-9f74-f894c75a8683 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.137403 Sep 15 04:27:19.424616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 293/612] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:19 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:19.522848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:19.523494 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:19.529287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.529737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:19.530507 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.530942 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:19.650452 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:19.657871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6fa91273-609d-43a9-ac6c-3bae52a62921 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.138678 Sep 15 04:27:19.658441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 320/613] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:19 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:19.944560 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:19.945095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:19.950782 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.951286 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:19.952044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:19.952475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.127187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:20.135353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:20.136841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:20.137992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-adf8bdb9-4619-49ba-aa33-9bd36b2aa80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.197333 Sep 15 04:27:20.138546 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 294/614] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:19 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:20.442024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:20.442735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:20.448704 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:20.449156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.449937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:20.451467 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.636794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:20.644219 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f3252952-3ddf-4885-be0a-d31ae342e99a tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.206502 Sep 15 04:27:20.644795 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 321/615] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:20 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:20.673549 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:20.674246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:20.680995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:20.681443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.682212 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:20.682645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.719385 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-22c34288-9321-4fcd-bf2c-d187c384dc35 req-d592b073-d3e1-4cc6-8a3c-fbc3a72c49f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e12d09-da83-4085-81f6-7bd52830b946", "tag": "d4dae746-4e31-4069-b2f0-c1f5fd6968e3"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:20.721014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:20.721014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:27:20.728642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-22c34288-9321-4fcd-bf2c-d187c384dc35 req-d592b073-d3e1-4cc6-8a3c-fbc3a72c49f1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:20.729178 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-22c34288-9321-4fcd-bf2c-d187c384dc35 req-d592b073-d3e1-4cc6-8a3c-fbc3a72c49f1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:20.740652 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-22c34288-9321-4fcd-bf2c-d187c384dc35 req-d592b073-d3e1-4cc6-8a3c-fbc3a72c49f1 service nova] Creating event network-changed:d4dae746-4e31-4069-b2f0-c1f5fd6968e3 for instance f6e12d09-da83-4085-81f6-7bd52830b946 on hv-cinder-76015 Sep 15 04:27:20.745949 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-22c34288-9321-4fcd-bf2c-d187c384dc35 req-d592b073-d3e1-4cc6-8a3c-fbc3a72c49f1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030158 Sep 15 04:27:20.746694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 322/616] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:20.822487 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:20.829707 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c3ba488d-1fc2-4f12-90b3-cf706180d157 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.159883 Sep 15 04:27:20.830264 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 295/617] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:20 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:21.157149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:21.157843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:21.163849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.164305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:21.165085 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.165525 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:21.546458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:21.555846 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:21.558869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:21.560636 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-35f5350f-7e46-4a2c-9415-ac965fdec299 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.407592 Sep 15 04:27:21.561201 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 323/618] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:21 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:21.660719 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:21.662125 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:21.668329 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.668778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:21.669542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.669983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:21.845696 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:21.846300 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:21.846933 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:21.853439 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.853991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0a058734-d36c-45b8-a7ee-681d60370fec tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.196937 Sep 15 04:27:21.854117 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:21.854526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 296/619] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:21 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:21.854960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:21.855493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:22.047651 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:22.055825 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b588c32e-ae25-4e19-8965-86be556ce3a3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1675 microversion: 2.1 time: 0.213415 Sep 15 04:27:22.065626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 324/620] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:21 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1675 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:22.580046 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:22.580657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:22.601008 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:22.601954 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:22.602779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:22.603252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:22.745259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:22.753978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:22.756397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:22.758090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ae90c83a-fc9c-464d-8d20-18484a095214 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1725 microversion: 2.20 time: 0.181725 Sep 15 04:27:22.758742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 297/621] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:22 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:22.872171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:22.872791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:22.882344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:22.884836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:22.887189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:22.887703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.073628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:23.075062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:23.081137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:23.081868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.082883 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:23.084114 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.097870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:23.105866 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-332dd8d2-5781-4ff1-966a-d03e57b67bc5 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.237867 Sep 15 04:27:23.115882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 325/622] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:22 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:23.197296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-7de8e17e-f8b6-4191-ae2d-a5135587b606 req-08d2531c-f331-4e86-a18e-7f10e961c419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a894d8-561b-4dfb-9240-5df7076fcd2d", "name": "network-vif-deleted", "tag": "e7b06ebb-1f13-4862-a414-fb3771962da1"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:23.199658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:23.199658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:27:23.207850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-7de8e17e-f8b6-4191-ae2d-a5135587b606 req-08d2531c-f331-4e86-a18e-7f10e961c419 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:23.209179 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-7de8e17e-f8b6-4191-ae2d-a5135587b606 req-08d2531c-f331-4e86-a18e-7f10e961c419 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.222441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-7de8e17e-f8b6-4191-ae2d-a5135587b606 req-08d2531c-f331-4e86-a18e-7f10e961c419 service nova] Creating event network-vif-deleted:e7b06ebb-1f13-4862-a414-fb3771962da1 for instance 95a894d8-561b-4dfb-9240-5df7076fcd2d on hv-cinder-76015 Sep 15 04:27:23.229275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-7de8e17e-f8b6-4191-ae2d-a5135587b606 req-08d2531c-f331-4e86-a18e-7f10e961c419 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036018 Sep 15 04:27:23.230282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 326/623] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:23.341304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:23.351009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8c3d0a67-a54b-4e5a-b2f4-a517795ce1aa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 200 len: 1607 microversion: 2.1 time: 0.280942 Sep 15 04:27:23.352004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 298/624] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:23 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 1607 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:23.778998 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:23.780196 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:23.788145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:23.788993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.789980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:23.791396 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:23.862502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:23.873334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:23.876092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:23.877643 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b10a048e-d00f-4a7d-adba-0c4b0a781d48 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 200 len: 1657 microversion: 2.20 time: 0.103754 Sep 15 04:27:23.890003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 327/625] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:23 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 1657 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:24.111048 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-6116d8fb-2142-4031-ba92-87bd738193e3 req-ae745c65-37aa-4197-be53-fdb104ad426a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9af1a4f0-8870-46fa-8b33-7b855766dda3", "name": "network-vif-deleted", "tag": "667adf54-08b1-4536-be84-7783402a3a44"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:24.113252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:24.113252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:24.125047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-6116d8fb-2142-4031-ba92-87bd738193e3 req-ae745c65-37aa-4197-be53-fdb104ad426a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.125892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-6116d8fb-2142-4031-ba92-87bd738193e3 req-ae745c65-37aa-4197-be53-fdb104ad426a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.127177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:24.128790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:24.148869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.149637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.151537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.151978 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.155778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-6116d8fb-2142-4031-ba92-87bd738193e3 req-ae745c65-37aa-4197-be53-fdb104ad426a service nova] Creating event network-vif-deleted:667adf54-08b1-4536-be84-7783402a3a44 for instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 on hv-cinder-76015 Sep 15 04:27:24.163120 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-6116d8fb-2142-4031-ba92-87bd738193e3 req-ae745c65-37aa-4197-be53-fdb104ad426a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056628 Sep 15 04:27:24.172659 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 299/626] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:24.309536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:24.318636 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-524e164d-d687-4673-9f0c-995878219dbd tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.197874 Sep 15 04:27:24.327570 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 328/627] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:24 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:24.371262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:24.372178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:24.379979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.380859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.381817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.382393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.396552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. Sep 15 04:27:24.397570 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:27:24.398722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d5e57a22-99c5-4b06-9735-0124275b799e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 404 len: 111 microversion: 2.1 time: 0.032627 Sep 15 04:27:24.399819 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 300/628] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:24 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:27:24.408012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d22d3d0e-84ac-4ac6-8854-213fa7567e6b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '.version_select at 0x7f02a22a8550>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:24.412946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d22d3d0e-84ac-4ac6-8854-213fa7567e6b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [711e2de0-be8d-4def-bc46-ace91f7d6a34] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:27:24.897724 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:24.901016 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:24.909092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.909683 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.910585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:24.911153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:24.926234 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. Sep 15 04:27:24.927310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:27:24.928364 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ae1edbd3-a27c-4f4e-8d33-d7b797924409 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 404 len: 111 microversion: 2.20 time: 0.035007 Sep 15 04:27:24.930410 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 301/629] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:24 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 04:27:24.938625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a494d310-2086-4ae0-a05d-03c15e2127b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '.version_select at 0x7f02a2c1c310>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:24.942409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a494d310-2086-4ae0-a05d-03c15e2127b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [fa32bd44-98c9-4305-b0b7-097803e297cb] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:27:25.430591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [None req-d22d3d0e-84ac-4ac6-8854-213fa7567e6b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [711e2de0-be8d-4def-bc46-ace91f7d6a34] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 46920. Sep 15 04:27:25.450140 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d22d3d0e-84ac-4ac6-8854-213fa7567e6b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-204474707" status: 202 len: 0 microversion: 2.1 time: 1.045845 Sep 15 04:27:25.450888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 329/630] 10.222.0.37 () {58 vars in 1218 bytes} [Wed Sep 15 04:27:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-204474707 => generated 0 bytes in 1047 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:27:25.465287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:25.470630 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:25.484868 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:25.485327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:25.486125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:25.486548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:25.654160 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:25.661801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-15d4302d-ce55-4e8c-a9b4-f8dd493f8bd9 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.209519 Sep 15 04:27:25.662615 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 330/631] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:25 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:25.958941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [None req-a494d310-2086-4ae0-a05d-03c15e2127b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [fa32bd44-98c9-4305-b0b7-097803e297cb] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 46928. Sep 15 04:27:25.979157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a494d310-2086-4ae0-a05d-03c15e2127b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091657709" status: 204 len: 0 microversion: 2.20 time: 1.044490 Sep 15 04:27:25.979919 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 302/632] 10.222.0.37 () {60 vars in 1262 bytes} [Wed Sep 15 04:27:24 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1091657709 => generated 0 bytes in 1046 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 15 04:27:26.187835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: .version_select at 0x7f02a23c3820>, body: {"keypair": {"name": "tempest-keypair-1450312213"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:26.213079 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:26.217815 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:26.324714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:26.328329 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:26.340818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d15aecbd-652e-4ed8-9b34-39b575ba634a tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.158974 Sep 15 04:27:26.341408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 331/633] 10.222.0.37 () {60 vars in 1158 bytes} [Wed Sep 15 04:27:26 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:26.689308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:26.690240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:26.699865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:26.700951 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:26.701747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:26.702188 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:26.858877 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: .version_select at 0x7f02a23715e0>, body: {"keypair": {"name": "tempest-keypair-2006210006"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:26.874793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:26.877606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:26.884741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bd40bbbf-5491-459b-b311-da0604a83cea tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.208339 Sep 15 04:27:26.885310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 303/634] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:26 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:26.887821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:27.156277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:27.160940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'key_pairs'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:27.177264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f6f756f3-6a4f-41f7-b8db-a4f5fbc049f8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.322297 Sep 15 04:27:27.178033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 332/635] 10.222.0.37 () {62 vars in 1199 bytes} [Wed Sep 15 04:27:26 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 324 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Sep 15 04:27:27.244999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-1d6a238b-7089-4994-b800-733de87d77f3 req-0d8c78d1-fe80-4893-94cd-d3e9d15b1774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e12d09-da83-4085-81f6-7bd52830b946", "name": "network-vif-plugged", "status": "completed", "tag": "d4dae746-4e31-4069-b2f0-c1f5fd6968e3"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:27.248754 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:27.248754 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:27.262714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1d6a238b-7089-4994-b800-733de87d77f3 req-0d8c78d1-fe80-4893-94cd-d3e9d15b1774 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:27.263541 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1d6a238b-7089-4994-b800-733de87d77f3 req-0d8c78d1-fe80-4893-94cd-d3e9d15b1774 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:27.282004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-1d6a238b-7089-4994-b800-733de87d77f3 req-0d8c78d1-fe80-4893-94cd-d3e9d15b1774 service nova] Creating event network-vif-plugged:d4dae746-4e31-4069-b2f0-c1f5fd6968e3 for instance f6e12d09-da83-4085-81f6-7bd52830b946 on hv-cinder-76015 Sep 15 04:27:27.290396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-1d6a238b-7089-4994-b800-733de87d77f3 req-0d8c78d1-fe80-4893-94cd-d3e9d15b1774 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050828 Sep 15 04:27:27.291012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 304/636] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:27:27.901867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:27.902754 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:27.909600 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:27.910326 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:27.911361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:27.912166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:28.066157 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1681722781", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0d61962a-5e93-4ef1-8adc-7c1123313d47"}], "security_groups": [{"name": "tempest-securitygroup--1899751976"}], "key_name": "tempest-keypair-1450312213", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:28.348027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:28.356901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] validate_networks() for [('0d61962a-5e93-4ef1-8adc-7c1123313d47', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:27:28.357377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-55a4f7cc-4e7c-4af3-a7ed-36df33b2d96b tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1319 microversion: 2.1 time: 0.459246 Sep 15 04:27:28.368427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 333/637] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:27 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:29.018664 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:27:29.019051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:27:29.019589 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:27:29.020023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:27:29.020493 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:27:29.029358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.029807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.030921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.031498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.052894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:29.057601 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Getting quotas for user 0853786744074c74ae4b7a86f191c813 and project 91a9aa7366104d72a142ebfb84ea383e. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:29.070068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:27:29.072648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:27:29.128447 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4c7711d8-75e2-4119-aff6-8331ca0f291b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.066532 Sep 15 04:27:29.146019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 305/638] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:27:28 2021] POST /compute/v2.1/servers => generated 402 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:27:29.147044 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a7fe7451-c61a-4531-97ff-4857f93ad77c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:29.148334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a7fe7451-c61a-4531-97ff-4857f93ad77c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:29.219847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a7fe7451-c61a-4531-97ff-4857f93ad77c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:29.229553 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a7fe7451-c61a-4531-97ff-4857f93ad77c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1238 microversion: 2.1 time: 0.087492 Sep 15 04:27:29.230160 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 334/639] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:29 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:29.376174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:29.377319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:29.385763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.386379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.387100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.387600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.576115 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:29.587170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-34709e1f-1b13-405f-b53f-4a1e522d6965 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1508 microversion: 2.1 time: 0.215317 Sep 15 04:27:29.588013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 306/640] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:29 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:29.604859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2529ed4b-d96a-4383-8106-697b8c75f5dc", "device": "/dev/sdb"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:29.606313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:29.612797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.613383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.615246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:29.615933 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:29.638825 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1218376912", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "25bc0a6f-df06-4b45-a772-55a6cdb78da7"}], "security_groups": [{"name": "tempest-securitygroup--319007478"}], "key_name": "tempest-keypair-2006210006", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:29.829514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] validate_networks() for [('25bc0a6f-df06-4b45-a772-55a6cdb78da7', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:27:29.967040 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0704c015-c922-4970-87da-c02817087718 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "POST /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365945 Sep 15 04:27:29.967926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 335/641] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:27:29 2021] POST /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:27:30.256413 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:30.259059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:30.278134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:30.278701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:30.280530 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:30.281880 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:30.427555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:30.437131 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1eb59883-19ec-401d-b6ba-ba457c8b5f9e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1298 microversion: 2.1 time: 0.193648 Sep 15 04:27:30.443212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 336/642] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:30 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1298 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:31.100506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:27:31.101191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:27:31.101323 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:27:31.105846 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:27:31.106274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:27:31.121071 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:31.121527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:31.122401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:31.123072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:31.141451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for project 35a581abeebb41f3b727ee96e0441f04. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:31.145985 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Getting quotas for user e764d4c1d57740c1808fd9c877f46008 and project 35a581abeebb41f3b727ee96e0441f04. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:31.163669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:27:31.165875 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:27:31.224859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cfa17a86-47f3-4b01-870b-381004020ac3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.588999 Sep 15 04:27:31.225968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 307/643] 10.222.0.37 () {62 vars in 1188 bytes} [Wed Sep 15 04:27:29 2021] POST /compute/v2.1/servers => generated 401 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 15 04:27:31.235561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:31.236233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:31.460730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:31.460730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:31.468093 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:31.469270 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:31.470535 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:31.472842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:31.534707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:31.542331 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:31.547757 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:31.551242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-98daea80-a624-4218-8214-d481fefed6d0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1282 microversion: 2.20 time: 0.317168 Sep 15 04:27:31.552371 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 337/644] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:31 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1282 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:27:31.697504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:31.706640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-834fbc3d-d45a-4929-b718-b192774070ca tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1296 microversion: 2.1 time: 0.251572 Sep 15 04:27:31.717837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 308/645] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:31 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1296 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:32.573754 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:32.575766 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:32.584974 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:32.585428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:32.586220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:32.586661 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:32.664834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:32.673175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:32.674977 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:32.676158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-218c14cd-29da-47e9-bf99-c29f8922fe71 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1340 microversion: 2.20 time: 0.110058 Sep 15 04:27:32.676993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 338/646] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:32 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1340 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:32.724747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:32.726085 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:32.733287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:32.733747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:32.734538 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:32.734981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:33.047003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:33.059482 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c175588f-7677-46ad-8c9e-1765a2300170 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.339058 Sep 15 04:27:33.061442 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 309/647] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:32 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:33.302243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-3b94d83b-cf70-4b00-8685-8e24e2b4a674 req-9cbe5615-b3ec-4489-a081-49c5470dbc88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561a3419-fa52-4814-bb17-5983d70b6324", "tag": "974ea781-38b4-42bd-93ac-1ce7b9ef33c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:33.308021 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:33.308021 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:27:33.346300 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-3b94d83b-cf70-4b00-8685-8e24e2b4a674 req-9cbe5615-b3ec-4489-a081-49c5470dbc88 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:33.346990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-3b94d83b-cf70-4b00-8685-8e24e2b4a674 req-9cbe5615-b3ec-4489-a081-49c5470dbc88 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:33.362267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-3b94d83b-cf70-4b00-8685-8e24e2b4a674 req-9cbe5615-b3ec-4489-a081-49c5470dbc88 service nova] Creating event network-changed:974ea781-38b4-42bd-93ac-1ce7b9ef33c7 for instance 561a3419-fa52-4814-bb17-5983d70b6324 on hv-cinder-76015 Sep 15 04:27:33.375593 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-3b94d83b-cf70-4b00-8685-8e24e2b4a674 req-9cbe5615-b3ec-4489-a081-49c5470dbc88 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081812 Sep 15 04:27:33.376821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 339/648] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:33.697545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:33.698571 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:33.708382 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:33.710184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:33.711960 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:33.713057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:34.037479 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:34.048832 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:34.053367 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:34.055333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3be5f8f3-fbfa-4d31-8dff-89c98de507bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.364510 Sep 15 04:27:34.057412 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 310/649] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:33 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:34.087684 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:34.090212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:34.097705 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:34.100082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:34.101203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:34.101878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:34.329398 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:34.340821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9cd76964-7203-4e87-9189-f4356d93bf8b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.266591 Sep 15 04:27:34.341402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 340/650] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:34 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:35.065962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-04d4f978-e11a-4cb1-a7b0-672147dc61a4 req-5293d808-37a3-433e-9092-c4bd8375cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:35.069042 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:35.069042 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:35.078470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:35.079557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:35.091703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:35.093116 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:35.094474 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:35.095233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:35.098059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-04d4f978-e11a-4cb1-a7b0-672147dc61a4 req-5293d808-37a3-433e-9092-c4bd8375cf3a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:35.099206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-04d4f978-e11a-4cb1-a7b0-672147dc61a4 req-5293d808-37a3-433e-9092-c4bd8375cf3a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:35.112138 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-04d4f978-e11a-4cb1-a7b0-672147dc61a4 req-5293d808-37a3-433e-9092-c4bd8375cf3a service nova] Creating event network-changed:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:27:35.118645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-04d4f978-e11a-4cb1-a7b0-672147dc61a4 req-5293d808-37a3-433e-9092-c4bd8375cf3a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057293 Sep 15 04:27:35.119610 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 311/651] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:35.269038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:35.278616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:35.280562 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:35.281956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cd0175c4-8d21-4ce3-a0b3-5282d2f1fdd2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.208785 Sep 15 04:27:35.282807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 341/652] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:35 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:35.358540 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:35.359351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:35.366535 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:35.366983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:35.367842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:35.368288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:35.569724 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:35.580957 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-371dee56-3040-49e3-a5dc-05ca2100bf64 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.226439 Sep 15 04:27:35.581599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 312/653] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:35 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:36.301716 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:36.302423 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:36.308645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:36.309579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:36.310636 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:36.311346 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:36.468027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:36.493132 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:36.496734 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:36.498853 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-763e0348-16f9-4259-8475-bbecdc195d39 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.201812 Sep 15 04:27:36.499798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 342/654] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:36 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:36.601258 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:36.602098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:36.607884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:36.608330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:36.609090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:36.609750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:36.768048 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:36.777599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-704e4d92-c9cc-46d8-ac78-18363a16e116 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.179868 Sep 15 04:27:36.778232 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 313/655] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:36 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:37.517197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:37.517810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:37.528677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:37.529133 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:37.529932 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:37.530370 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:37.766057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:37.778347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:37.780917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:37.782289 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b294c7bc-9b41-4875-bf73-52510176d644 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.268792 Sep 15 04:27:37.791229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 343/656] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:37 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:37.798872 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:37.801065 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:37.808095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:37.808924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:37.810057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:37.810803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:38.010461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:38.021803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3cad857e-6743-49f5-bac8-f0b1b34d23cd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.225763 Sep 15 04:27:38.022920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 314/657] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:37 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:38.806057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:38.807465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:38.814802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:38.815691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:38.816683 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:38.818080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:39.000638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:39.011047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:39.014660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:39.015920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-587215f3-0df9-4dc3-aa8d-fed7392046fb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.215438 Sep 15 04:27:39.016497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 344/658] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:38 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:39.038475 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:39.039097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:39.045870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:39.046573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:39.048152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:39.048784 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:39.244232 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:39.253005 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ee7ee606-b65a-4e06-9e21-272ac40137dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.218832 Sep 15 04:27:39.263582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 315/659] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:39 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:40.036188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:40.037686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:40.045018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.045469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.047157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.048101 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.180831 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:40.191014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:40.192824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:40.194066 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3f23fd9f-27dc-4924-91c9-b7f23c1231d5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.163363 Sep 15 04:27:40.194738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 345/660] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:40 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:40.272545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:40.273739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:40.280135 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.280784 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.281870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.282465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.429083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:40.437826 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b128e97a-045f-4cb5-a01f-bd52d44bcbbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.170032 Sep 15 04:27:40.438976 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 316/661] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:40 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:40.780430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:40.780941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:40.790238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.790689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.792165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.792607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.833734 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:27:40.961292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-48bf69c1-12d7-4793-9d3d-58dea27c7c9e tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "DELETE /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 204 len: 0 microversion: 2.1 time: 0.183172 Sep 15 04:27:40.961953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 346/662] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:27:40 2021] DELETE /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:27:40.972019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:40.972660 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:40.980466 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.980923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:40.981710 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:40.982146 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:41.202876 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:41.215184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-01a13c0f-6179-4441-ba71-0057f1e23150 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1578 microversion: 2.1 time: 0.248393 Sep 15 04:27:41.233357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 317/663] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:40 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:41.234755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:41.236889 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:41.244212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:41.245005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:41.245964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:41.246614 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:41.413265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:41.421369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:41.423668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:41.424823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6d3459ba-c935-430a-b3f0-6f22fe171d98 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.215471 Sep 15 04:27:41.425457 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 347/664] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:41 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:27:41.455318 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:41.456529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:41.462915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:41.463621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:41.464572 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:41.465307 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:41.639494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:41.649223 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ebcfb75c-ecf1-4266-8407-81a2d9a2ec25 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.197535 Sep 15 04:27:41.649966 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 318/665] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:41 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:42.237311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:42.239259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:42.247029 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.247781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.248734 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.249167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.403880 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:42.418691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e45e557a-6957-4a68-a148-6f5cf47ae0ac tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1578 microversion: 2.1 time: 0.184837 Sep 15 04:27:42.429369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 348/666] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:42 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1578 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:42.444028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:42.445014 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:42.453583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.454400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.455450 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.456688 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.666030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:42.667059 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:42.679577 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.684752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.685797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:42.686433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:42.713591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:42.732034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:42.738488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:42.744653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8d3763cc-5134-4399-ad54-ff2334f68069 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.305029 Sep 15 04:27:42.745836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 319/667] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:42 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:42.890872 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:42.900890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e37c7b83-e8de-4dae-96fe-9dc742ae5bb9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.238107 Sep 15 04:27:42.901870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 349/668] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:42 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:43.437246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:43.438445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:43.445094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.445552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.446326 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.446959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.475685 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-c51bcf43-e055-4e79-8845-f5dd82a9cfca req-7d5dc7d1-8a99-4927-97d7-615d8f630f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a3419-fa52-4814-bb17-5983d70b6324", "name": "network-vif-plugged", "status": "completed", "tag": "974ea781-38b4-42bd-93ac-1ce7b9ef33c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:43.477878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:43.477878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:27:43.490925 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-c51bcf43-e055-4e79-8845-f5dd82a9cfca req-7d5dc7d1-8a99-4927-97d7-615d8f630f3e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.491616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-c51bcf43-e055-4e79-8845-f5dd82a9cfca req-7d5dc7d1-8a99-4927-97d7-615d8f630f3e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.524961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-c51bcf43-e055-4e79-8845-f5dd82a9cfca req-7d5dc7d1-8a99-4927-97d7-615d8f630f3e service nova] Creating event network-vif-plugged:974ea781-38b4-42bd-93ac-1ce7b9ef33c7 for instance 561a3419-fa52-4814-bb17-5983d70b6324 on hv-cinder-76015 Sep 15 04:27:43.532843 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-c51bcf43-e055-4e79-8845-f5dd82a9cfca req-7d5dc7d1-8a99-4927-97d7-615d8f630f3e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060816 Sep 15 04:27:43.533763 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 350/669] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:27:43.625297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:43.633612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-992ee6c1-8e3f-49dd-9f59-384ed2fe6e5f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1578 microversion: 2.1 time: 0.200942 Sep 15 04:27:43.634181 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 320/670] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:43 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:43.763810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:43.764851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:43.775335 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.775802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.778626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.779741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.920526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:43.921144 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:43.928263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.928721 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.929509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:43.929942 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:43.950439 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:43.964641 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:43.966278 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:43.967762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d9034e3f-a52a-43af-9fb7-1de2f69c346c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.208411 Sep 15 04:27:43.979363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 351/671] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:43 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:44.079897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:44.088393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7c8c0323-e236-4053-a4d7-f2772d37d283 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.174398 Sep 15 04:27:44.088969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 321/672] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:43 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:44.650136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:44.651705 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:44.657740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:44.658190 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:44.659369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:44.660035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:44.811077 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:44.823205 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-436e2d6a-a6e1-4628-a737-372f4df75158 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1578 microversion: 2.1 time: 0.176536 Sep 15 04:27:44.824566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 352/673] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:44 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:44.986023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:44.986652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:44.994348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:44.994804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:44.995821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:44.996267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:45.170564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:45.179299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:45.183848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:45.187979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c1092e10-1293-4a16-ae60-011ba5445011 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.205528 Sep 15 04:27:45.202917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 322/674] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:44 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:45.379296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:45.380067 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:45.388139 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:45.388590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:45.389373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:45.389808 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:45.693612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:45.711585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2e773109-efe9-48db-a5d1-c85a10f28dd3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1364 microversion: 2.1 time: 0.606588 Sep 15 04:27:45.714005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 353/675] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:45 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1364 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:45.840959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:45.841949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:45.852103 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:45.852555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:45.853345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:45.853779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.050173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:46.058674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-23d7be44-bdcb-4c5b-b5f4-c5998598583a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1578 microversion: 2.1 time: 0.221440 Sep 15 04:27:46.059852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 323/676] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:45 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:46.205789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:46.206626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:46.214351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.217275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.218313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.221665 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.438167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:46.465972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:46.468240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:46.469402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-de4c7bea-a813-4a72-a534-c24833de8aff tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.267427 Sep 15 04:27:46.486938 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 354/677] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:46 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:46.534201 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-1dc06214-d965-4e3a-84da-d6035a559649 req-22a309a1-1982-42d4-8524-494dfbe4e243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551493b4-5ef7-4c4d-9b6a-d89dcaf16dde", "name": "network-vif-deleted", "tag": "924bd0c9-8dca-4c2c-98d4-521045ba17e5"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:46.536714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:46.536714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:46.545895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1dc06214-d965-4e3a-84da-d6035a559649 req-22a309a1-1982-42d4-8524-494dfbe4e243 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.546645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1dc06214-d965-4e3a-84da-d6035a559649 req-22a309a1-1982-42d4-8524-494dfbe4e243 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.560935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-1dc06214-d965-4e3a-84da-d6035a559649 req-22a309a1-1982-42d4-8524-494dfbe4e243 service nova] Creating event network-vif-deleted:924bd0c9-8dca-4c2c-98d4-521045ba17e5 for instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde on hv-cinder-76015 Sep 15 04:27:46.569131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-1dc06214-d965-4e3a-84da-d6035a559649 req-22a309a1-1982-42d4-8524-494dfbe4e243 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040896 Sep 15 04:27:46.574499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 324/678] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:46.743177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:46.748214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:46.761557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.764399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.766926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.767497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.852294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-875edff6-68f1-40b5-85fd-224b46c24007 req-8237ee6f-2fce-4b67-8492-c80ffdf9ace6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "name": "network-vif-plugged", "status": "completed", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:46.854720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:46.854720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:46.882503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-875edff6-68f1-40b5-85fd-224b46c24007 req-8237ee6f-2fce-4b67-8492-c80ffdf9ace6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:46.883668 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-875edff6-68f1-40b5-85fd-224b46c24007 req-8237ee6f-2fce-4b67-8492-c80ffdf9ace6 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:46.925385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-875edff6-68f1-40b5-85fd-224b46c24007 req-8237ee6f-2fce-4b67-8492-c80ffdf9ace6 service nova] Creating event network-vif-plugged:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:27:46.939190 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-875edff6-68f1-40b5-85fd-224b46c24007 req-8237ee6f-2fce-4b67-8492-c80ffdf9ace6 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092891 Sep 15 04:27:46.945817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 325/679] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:47.077278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:47.078934 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:47.108661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.112396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.113520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.114203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.143080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:47.156580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-23dba80d-1770-4333-9887-d8f247c022b2 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1550 microversion: 2.1 time: 0.425033 Sep 15 04:27:47.170993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 355/680] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:46 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1550 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:47.183945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:47.186669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:47.204606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.205391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.206846 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.207821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.211736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.212424 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.213102 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lazy-loading 'fault' on Instance uuid 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:27:47.439076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:47.461270 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-43d4401f-d63f-4964-b490-0d3bcceae639 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 200 len: 1230 microversion: 2.1 time: 0.387419 Sep 15 04:27:47.464873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 326/681] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:47 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 1230 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:47.516235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:47.517129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:47.546222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.549258 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.555025 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:47.555765 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:47.586780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b141ef80-c440-45c8-8903-3ac7bf6784b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.413712 Sep 15 04:27:47.593802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 356/682] 10.222.0.37 () {58 vars in 1275 bytes} [Wed Sep 15 04:27:47 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-interface => generated 284 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:48.220081 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:48.229435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:48.242514 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:48.244080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f58b7e1d-feaa-4b1b-b338-98e97bdf6b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1407 microversion: 2.20 time: 0.749765 Sep 15 04:27:48.244863 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 327/683] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:47 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1407 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:48.480313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:48.481626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:48.493253 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:48.494040 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:48.494903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:48.495435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:48.524576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] HTTP exception thrown: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. Sep 15 04:27:48.525401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Returning 404 to user: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:27:48.527207 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-62292c58-eb93-4457-bdf6-f49cf8190f16 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 404 len: 111 microversion: 2.1 time: 0.050197 Sep 15 04:27:48.549339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 357/684] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:48 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:27:48.677810 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1141503416", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-460250898", "security_groups": [{"name": "tempest-secgroup-smoke-1810072556"}], "block_device_mapping_v2": [{"uuid": "17ea9873-0490-424c-bf5c-14f09450e40d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:48.960594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:48.971330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:48.977904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:48.977904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:48.977904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:48.991618 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:49.026756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] validate_networks() for [('cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:27:49.169842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lazy-loading 'services' on Instance uuid f6e12d09-da83-4085-81f6-7bd52830b946 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:27:49.261503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-06b8649c-e50d-42d1-9192-d2153d6d0815 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946/os-volume_attachments/2529ed4b-d96a-4383-8106-697b8c75f5dc" status: 202 len: 0 microversion: 2.1 time: 0.306009 Sep 15 04:27:49.263510 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 358/685] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:27:48 2021] DELETE /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946/os-volume_attachments/2529ed4b-d96a-4383-8106-697b8c75f5dc => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:27:49.599911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:49.600611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:49.610777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:49.614524 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:49.615570 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:49.616169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.153479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:50.162623 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:50.168850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:50.176806 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b6931244-43a8-43b5-8790-9f4b681329ab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1599 microversion: 2.20 time: 0.911703 Sep 15 04:27:50.177610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 359/686] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:27:49 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1599 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:27:50.194827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:50.195622 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:50.209201 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.209931 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.210898 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.211514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.480693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e5aba0c3-a309-47d9-b69a-8522859ff48a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.289590 Sep 15 04:27:50.483581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 360/687] 10.222.0.37 () {60 vars in 1316 bytes} [Wed Sep 15 04:27:50 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-interface => generated 284 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:27:50.491674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:50.493004 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:50.503774 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.504767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.505605 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.506055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.549125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:27:50.637361 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:27:50.638941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:27:50.639671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:27:50.640432 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:27:50.641723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:27:50.656692 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.657159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.658075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.658648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.705398 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:50.711907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for user fc599faf327249919f8dc76e65061ae3 and project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:50.744033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6c8f5f9f-ce36-4886-80d2-e725a2de03ab tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "DELETE /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 204 len: 0 microversion: 2.1 time: 0.257701 Sep 15 04:27:50.746476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 361/688] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:27:50 2021] DELETE /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:27:50.763348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:50.767535 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:50.775812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.776261 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.777051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:50.777484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:50.840705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:27:50.842810 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17ea9873-0490-424c-bf5c-14f09450e40d',volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:27:51.063115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:51.073388 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7fa3d3c1-2835-4c9c-86e5-34b8b2583078 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1514 microversion: 2.1 time: 0.322192 Sep 15 04:27:51.074619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 362/689] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:50 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1514 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:51.099373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:51.100842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:51.107841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a6c54abb-997c-4b9c-89ae-958fce3de9e5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.435285 Sep 15 04:27:51.110199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:51.111495 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 328/690] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:27:48 2021] POST /compute/v2.1/servers => generated 406 bytes in 2440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:27:51.115252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:51.116567 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:51.117379 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:51.124976 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-bc18a0e6-5a83-4e1a-b8fa-c53b4af23ed7 req-7280ec0b-7570-4b21-b996-a0f1eca595a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "561a3419-fa52-4814-bb17-5983d70b6324", "tag": "974ea781-38b4-42bd-93ac-1ce7b9ef33c7"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:51.128694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:51.128694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:51.152051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-bc18a0e6-5a83-4e1a-b8fa-c53b4af23ed7 req-7280ec0b-7570-4b21-b996-a0f1eca595a0 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:51.152741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-bc18a0e6-5a83-4e1a-b8fa-c53b4af23ed7 req-7280ec0b-7570-4b21-b996-a0f1eca595a0 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:51.179338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-bc18a0e6-5a83-4e1a-b8fa-c53b4af23ed7 req-7280ec0b-7570-4b21-b996-a0f1eca595a0 service nova] Creating event network-changed:974ea781-38b4-42bd-93ac-1ce7b9ef33c7 for instance 561a3419-fa52-4814-bb17-5983d70b6324 on hv-cinder-76015 Sep 15 04:27:51.189794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-bc18a0e6-5a83-4e1a-b8fa-c53b4af23ed7 req-7280ec0b-7570-4b21-b996-a0f1eca595a0 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076658 Sep 15 04:27:51.196059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 329/691] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:51.202532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d5d7a193-3306-4f2b-9f52-73cf5f1f4036 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:51.203742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d5d7a193-3306-4f2b-9f52-73cf5f1f4036 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:51.233153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cd5428e0-3c98-4905-b363-09dc9a71b199 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 0.157010 Sep 15 04:27:51.237799 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 363/692] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:51 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:27:51.282924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d5d7a193-3306-4f2b-9f52-73cf5f1f4036 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:51.295075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d5d7a193-3306-4f2b-9f52-73cf5f1f4036 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1094 microversion: 2.1 time: 0.095754 Sep 15 04:27:51.296891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 330/693] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:51 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:51.984213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:51.985466 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:51.996917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:51.997381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:51.998179 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:51.998624 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.026468 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-b753e0af-78bb-4c99-bcf2-d5a425ba7bfd req-edb801df-2911-4467-bf81-3f68df45d651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:52.028837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:52.028837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:52.038692 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-b753e0af-78bb-4c99-bcf2-d5a425ba7bfd req-edb801df-2911-4467-bf81-3f68df45d651 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.040502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-b753e0af-78bb-4c99-bcf2-d5a425ba7bfd req-edb801df-2911-4467-bf81-3f68df45d651 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.077559 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-b753e0af-78bb-4c99-bcf2-d5a425ba7bfd req-edb801df-2911-4467-bf81-3f68df45d651 service nova] Creating event network-changed:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:27:52.089878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-b753e0af-78bb-4c99-bcf2-d5a425ba7bfd req-edb801df-2911-4467-bf81-3f68df45d651 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076283 Sep 15 04:27:52.092017 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 331/694] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 15 04:27:52.101461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:52.102174 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:52.121470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.121932 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.122733 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.123198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.144612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-590d2214-345d-48bc-9056-9f1ff2507796 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 0.167236 Sep 15 04:27:52.145273 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 364/695] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:51 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:52.247117 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:52.248152 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:52.262014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.272810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.273795 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.280896 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.425199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6f2ac4ab-ff44-49f4-a4e7-a6de52b17eb0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 0.183141 Sep 15 04:27:52.433927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 365/696] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:52 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:27:52.442301 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:52.444699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:52.452217 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.453043 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.454079 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:52.454737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:52.531956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:52.556657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d7d854f8-9170-437b-b22b-28473d9b8e90 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1514 microversion: 2.1 time: 0.449171 Sep 15 04:27:52.568687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:52.577658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 332/697] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:52 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1514 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:52.583276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3d47ba54-1d95-47ba-9f07-e2d7e8b24b0a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1192 microversion: 2.1 time: 0.147634 Sep 15 04:27:52.598960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 366/698] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:52 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1192 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:53.155353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:53.156881 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:53.169857 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.172907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.173906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.177852 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.271617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-351c726f-4f91-49ca-8a17-6706ed41e2da tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 0.119490 Sep 15 04:27:53.272509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 333/699] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:53 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:53.437804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:53.439722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:53.466442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.467663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.473865 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.486181 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.594059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:53.595027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:53.610371 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.612792 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.617841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.618658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.637020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a3e50d49-9b49-44f9-841a-ff62bde6e9ea tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 0.205117 Sep 15 04:27:53.638927 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 367/700] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:53 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:27:53.644236 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:53.644985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:53.664800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.665267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.666173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.666628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.810570 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe0e3ce8ae724c5884edcc09234821c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ca5a27e1ff24fdf885395ee6ed8531b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:53.822078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5ba55a95-9e60-46dd-b460-cdddcfd731c2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 200 len: 1472 microversion: 2.1 time: 0.233193 Sep 15 04:27:53.832914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:53.834419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 334/701] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:53 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 1472 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:53.840216 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-76382300-e53d-4cd2-930b-95aad266cc51 req-7874b8c1-e7b5-454e-835b-d6e97da1ced1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e12d09-da83-4085-81f6-7bd52830b946", "name": "network-vif-deleted", "tag": "d4dae746-4e31-4069-b2f0-c1f5fd6968e3"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:53.842198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:53.842198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:27:53.845156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ad30b4cc-3a11-448b-b630-0cbd78c57d15 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1210 microversion: 2.1 time: 0.205987 Sep 15 04:27:53.845810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 368/702] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:53 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1210 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:53.852011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-76382300-e53d-4cd2-930b-95aad266cc51 req-7874b8c1-e7b5-454e-835b-d6e97da1ced1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:53.857528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-76382300-e53d-4cd2-930b-95aad266cc51 req-7874b8c1-e7b5-454e-835b-d6e97da1ced1 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:53.877763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-76382300-e53d-4cd2-930b-95aad266cc51 req-7874b8c1-e7b5-454e-835b-d6e97da1ced1 service nova] Creating event network-vif-deleted:d4dae746-4e31-4069-b2f0-c1f5fd6968e3 for instance f6e12d09-da83-4085-81f6-7bd52830b946 on hv-cinder-76015 Sep 15 04:27:53.883641 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-76382300-e53d-4cd2-930b-95aad266cc51 req-7874b8c1-e7b5-454e-835b-d6e97da1ced1 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047708 Sep 15 04:27:53.888454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 335/703] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:54.283215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:54.284691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:54.298874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.303750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.304610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.305055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.413292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-72895fa0-b65a-435c-a5ec-810c3de16f24 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 0.133987 Sep 15 04:27:54.416153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 369/704] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:54 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:54.649140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:54.650854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:54.657097 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.657726 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.658574 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.659083 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.718807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bb1f1971-6d4f-46c7-b00e-2fcc3c61e687 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 0.074812 Sep 15 04:27:54.720268 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 336/705] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:54 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:27:54.847351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:54.850077 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] [instance: f6e12d09-da83-4085-81f6-7bd52830b946] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:54.858022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.867366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:54.868348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:54.880562 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.883098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.885406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.886532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.890567 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.892556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:54.893136 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:54.921863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] HTTP exception thrown: Instance f6e12d09-da83-4085-81f6-7bd52830b946 could not be found. Sep 15 04:27:54.922723 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] Returning 404 to user: Instance f6e12d09-da83-4085-81f6-7bd52830b946 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:27:54.923770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1e67fc8b-9a64-4644-b4c6-726aafd0f0b2 tempest-VolumesSnapshotTestJSON-301746124 tempest-VolumesSnapshotTestJSON-301746124-project] 10.222.0.37 "GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946" status: 404 len: 111 microversion: 2.1 time: 0.087212 Sep 15 04:27:54.924830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 370/706] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:54 2021] GET /compute/v2.1/servers/f6e12d09-da83-4085-81f6-7bd52830b946 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:27:55.046714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-e555fa21-0ce2-4f3d-8ba2-9a289b8d215e req-da8950aa-5e13-4c1a-9640-22cf969054c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e944779f-4589-42ae-9de4-95c27db55bda", "tag": "62fee7db-47a8-40e5-8d05-015c16397921"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:55.048580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:27:55.048580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:27:55.063632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e555fa21-0ce2-4f3d-8ba2-9a289b8d215e req-da8950aa-5e13-4c1a-9640-22cf969054c3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:55.068323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-e555fa21-0ce2-4f3d-8ba2-9a289b8d215e req-da8950aa-5e13-4c1a-9640-22cf969054c3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:55.089547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-e555fa21-0ce2-4f3d-8ba2-9a289b8d215e req-da8950aa-5e13-4c1a-9640-22cf969054c3 service nova] Creating event network-changed:62fee7db-47a8-40e5-8d05-015c16397921 for instance e944779f-4589-42ae-9de4-95c27db55bda on hv-cinder-76015 Sep 15 04:27:55.103014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-e555fa21-0ce2-4f3d-8ba2-9a289b8d215e req-da8950aa-5e13-4c1a-9640-22cf969054c3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061236 Sep 15 04:27:55.106581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 371/707] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:27:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:27:55.115375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:55.128428 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-41aa9735-0b57-4e89-b021-e2154dc13c91 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.264103 Sep 15 04:27:55.139260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 337/708] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:54 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:55.426372 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:55.427637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:55.438713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:55.440409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:55.443285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:55.444123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:55.533612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-911f2c60-3fe3-4ee9-a88d-3e4b7bd005c5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 0.110479 Sep 15 04:27:55.534803 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 372/709] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:55 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:55.731652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:55.732716 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:55.738969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:55.739449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:55.740239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:55.740677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:55.804681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e35d3bec-5486-400d-8f9b-07539f481ed8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 0.078338 Sep 15 04:27:55.808525 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 338/710] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:55 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:27:56.147267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:56.148712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:56.155412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.156076 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:56.157012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.157705 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:56.297047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:56.305619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8392c50e-b5a6-48f5-8520-0584cbd99707 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.163480 Sep 15 04:27:56.306387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 373/711] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:56 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:56.475637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'create', calling method: .version_select at 0x7f02a2ac10d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-20565744"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:56.494173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:56.498020 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for user 91789bce1a7b424692ef805f21b4d187 and project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:56.545842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:56.546786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:56.553433 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.554089 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:56.555022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.555626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:56.622900 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-14b8a2d2-4225-4968-ab0a-52ff8b8f1b0b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 0.080674 Sep 15 04:27:56.623669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 374/712] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:56 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:56.645573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:56.649202 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for user 91789bce1a7b424692ef805f21b4d187 and project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'key_pairs'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:56.662732 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a60f275d-5548-4505-85b5-632533ce06ca tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 0.191105 Sep 15 04:27:56.663288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 339/713] 10.222.0.37 () {60 vars in 1158 bytes} [Wed Sep 15 04:27:56 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:56.711031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-730550621", "imageRef": "3cecf333-5796-4485-b927-ef184d5d1038", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-20565744", "networks": [{"uuid": "02038964-947d-4ac4-bf0d-e35b1897377f"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:56.760693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] validate_networks() for [('02038964-947d-4ac4-bf0d-e35b1897377f', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:27:56.817057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:56.818070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:56.824099 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.824551 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:56.825320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:56.825752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.124070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:27:57.124500 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:27:57.125009 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:27:57.125427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:27:57.125845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:27:57.134907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.135489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.136510 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.137019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.154855 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:27:57.158805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Getting quotas for user 91789bce1a7b424692ef805f21b4d187 and project 9e4045049beb4f7b999e66c393eb47a2. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:27:57.171929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:27:57.174285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3cecf333-5796-4485-b927-ef184d5d1038',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:27:57.219581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ed1337b7-7e45-4b0e-a947-f71aa6826939 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512537 Sep 15 04:27:57.220218 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 375/714] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:27:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:27:57.230143 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f116f627-db28-44ac-ba86-8f63fe1fa693 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:57.230750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f116f627-db28-44ac-ba86-8f63fe1fa693 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:57.285548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f116f627-db28-44ac-ba86-8f63fe1fa693 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:57.291986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f116f627-db28-44ac-ba86-8f63fe1fa693 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1256 microversion: 2.1 time: 0.065324 Sep 15 04:27:57.292479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 376/715] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:57 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1256 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:57.323518 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:57.324131 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:57.330780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.331185 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.332474 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.333131 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.457647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:57.465688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2643c814-c100-43ab-bef8-ecbfb79e47d8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.145833 Sep 15 04:27:57.466470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 377/716] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:57 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:57.633772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:27:57.634733 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:57.640595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.641041 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:57.641811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:57.642243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:59.517789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3f715996-2fb2-4e20-8857-9316add9f3f7 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 14 microversion: 2.1 time: 2.705144 Sep 15 04:27:59.518461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 340/717] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:27:56 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 14 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:27:59.523358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:59.524054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:59.530421 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:59.530925 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:59.531727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:59.532025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1870be28-b926-4732-a46b-ff6fac37bd9c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 14 microversion: 2.20 time: 1.901480 Sep 15 04:27:59.532482 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:59.532655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 378/718] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:27:57 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 14 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:27:59.540052 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:27:59.540780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:27:59.547940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:59.548546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:59.550583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:27:59.550583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:27:59.600612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:59.609153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d4cd1d51-c9c6-42c0-9d9e-460a7c9ab03e tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1260 microversion: 2.1 time: 0.089339 Sep 15 04:27:59.610004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 341/719] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:59 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:27:59.697883 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:27:59.705380 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-22c4ccc2-8426-44d2-bff1-db225b8cffb8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.171431 Sep 15 04:27:59.706157 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 379/720] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:27:59 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:00.528913 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:00.529954 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:00.543525 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:00.544443 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:00.551032 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:00.554528 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:00.554983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:00.555807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:00.556245 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:00.559194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:00.560070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:00.560487 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.056971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5dd0a0cf-9fff-4f9d-8caa-79272cccc375 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 27527 microversion: 2.1 time: 13.531469 Sep 15 04:28:14.057701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 342/721] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:00 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 27527 bytes in 13533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:14.062884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:14.063606 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:14.070389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.071016 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.071806 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.072235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.076231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3aa920db-4277-4021-889b-bca9dde5ac3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 27516 microversion: 2.20 time: 13.536090 Sep 15 04:28:14.077027 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 380/722] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:00 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 27516 bytes in 13538 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:14.083391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:14.084182 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:14.090606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.091065 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.091889 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.092322 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.255535 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:14.262982 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fa981903-f6f8-4201-895a-87d7916f3261 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.204200 Sep 15 04:28:14.271893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 343/723] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:14 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:14.272226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:14.275283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:14.275831 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:14.281627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.282330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.282465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-445f6b96-3c6c-4708-86be-f67ab92308d9 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.203712 Sep 15 04:28:14.283254 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.283915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.291472 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 381/724] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:14 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:14.306764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lazy-loading 'flavor' on Instance uuid 05e460d0-b6ba-4ca2-9cce-41a41748d73d {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:28:14.379614 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-264fa72e-b5ac-4e98-a696-06f59462ef8d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "POST /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d/action" status: 202 len: 0 microversion: 2.1 time: 0.114338 Sep 15 04:28:14.380325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 344/725] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:14 2021] POST /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:14.388249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:14.388865 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:14.394607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.395828 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.397339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.397956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.545104 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:14.552875 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a6d1ff0a-64ad-48d7-9b44-8baf51d66ed8 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.168226 Sep 15 04:28:14.553463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 382/726] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:14 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:14.708098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-f5924363-e4b0-4275-b4e0-ef4d318731e4 req-23b94428-a268-4030-9c07-07e8735d014e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:14.709720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:14.709720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:28:14.717629 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-f5924363-e4b0-4275-b4e0-ef4d318731e4 req-23b94428-a268-4030-9c07-07e8735d014e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:14.718070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-f5924363-e4b0-4275-b4e0-ef4d318731e4 req-23b94428-a268-4030-9c07-07e8735d014e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:14.729790 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-f5924363-e4b0-4275-b4e0-ef4d318731e4 req-23b94428-a268-4030-9c07-07e8735d014e service nova] Creating event network-changed:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:28:14.735166 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-f5924363-e4b0-4275-b4e0-ef4d318731e4 req-23b94428-a268-4030-9c07-07e8735d014e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105487 Sep 15 04:28:14.735821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 345/727] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:15.069783 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:15.070691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:15.076861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.077984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.078805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.079452 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.092114 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:15.093168 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:15.111610 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.112160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.112948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.113437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.173564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8c0493cc-2a81-4f01-b461-35bf0ea724be tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 27811 microversion: 2.1 time: 0.108639 Sep 15 04:28:15.177850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 383/728] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:15 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 27811 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:15.215944 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cecd7a28-1007-4bfc-8b83-9b2bd39b8753 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 27870 microversion: 2.20 time: 0.130666 Sep 15 04:28:15.216586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 346/729] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:15 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 27870 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:15.281206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:15.281897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:15.288312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.288764 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.289533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.289968 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.300172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:15.300995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:15.307975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.308426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.309190 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.309624 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.492659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:15.495527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:15.501305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f8c2ee41-e4ba-44fa-bd97-9f3b4b731020 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.224216 Sep 15 04:28:15.501929 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 384/730] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:15 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:15.504684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fb1d4c63-b4da-4af8-8bd9-3dcbbf51f4db tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.207323 Sep 15 04:28:15.505574 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 347/731] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:15 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:15.571146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:15.571779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:15.577584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.578033 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.578806 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:15.579298 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:15.701163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:15.709117 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c09637e6-8b02-4661-a616-daaaea672a2e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.142225 Sep 15 04:28:15.709696 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 385/732] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:15 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:16.185456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:16.186451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:16.193469 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.193926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.194698 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.195162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.227422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:16.228469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:16.234627 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.235264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.236094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.236597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.271779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e1ce0269-7143-4ebe-9933-ff320107deee tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28072 microversion: 2.1 time: 0.089717 Sep 15 04:28:16.272467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 348/733] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:16 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28072 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:16.321496 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9fd21b05-0248-4b7d-9a1c-cf108bebec69 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28179 microversion: 2.20 time: 0.097813 Sep 15 04:28:16.322479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 386/734] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:16 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:16.518981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:16.520284 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:16.525138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:16.526386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:16.527504 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.528496 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.529809 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.530580 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.535263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.535720 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.536565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.537005 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.935986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:16.941070 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:16.944650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f9d543f0-8c8b-4ca0-b1bf-fe61c2c0aca1 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.429871 Sep 15 04:28:16.953657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 349/735] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:16 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:16.953657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:16.953657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:16.955694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.956149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.956930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:16.957131 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1d2a34a9-90c6-4d81-aaed-94af6a2fa458 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.438975 Sep 15 04:28:16.957484 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:16.958117 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 387/736] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:16 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:17.078714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:17.086599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-610bd4cb-1be1-4fe3-aa25-f76821f13177 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.140411 Sep 15 04:28:17.087178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 350/737] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:16 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:17.283444 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:17.284356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:17.291484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.291880 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.292647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.293082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.333841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:17.334808 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:17.340839 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.341183 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.341961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.342416 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.403812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-77c3846b-1ce0-4f7e-a6f6-a16d4a6d85bf tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28180 microversion: 2.1 time: 0.123831 Sep 15 04:28:17.405317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 388/738] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:17 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28180 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:17.446378 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-82cbcd37-0418-459a-92cb-6d3e5da39a61 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28181 microversion: 2.20 time: 0.117133 Sep 15 04:28:17.450243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 351/739] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:17 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28181 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:17.963694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:17.964396 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:17.970907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.971451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.972249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.972730 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.977294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:17.978372 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:17.984580 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.985034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:17.985873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:17.986317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.166250 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:18.170915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:18.177504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9b2abf66-e834-4b68-a3e9-3db32cd14961 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.217672 Sep 15 04:28:18.178373 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 389/740] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:17 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:18.187388 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b179d947-5259-4432-a858-e18059c78901 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.209803 Sep 15 04:28:18.187388 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 352/741] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:17 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:18.191064 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:18.192299 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:18.198143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.198596 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.199395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.199834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.331176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:18.340428 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5fe123aa-f2f0-4204-b401-e9268fa516ef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.157863 Sep 15 04:28:18.341914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 353/742] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:18 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:18.416218 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:18.417891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:18.424139 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.424863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.425669 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.426665 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.460488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:18.461922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:18.468746 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.469595 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.470481 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.471009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.497720 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-407e3792-86b9-4bad-864c-e1d8cd44c0e8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28180 microversion: 2.1 time: 0.085056 Sep 15 04:28:18.498625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 390/743] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:18 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28180 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:18.541452 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7cc569de-b4f2-44e5-91f5-ccbf8f1e07a8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28181 microversion: 2.20 time: 0.087026 Sep 15 04:28:18.545477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 354/744] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:18 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28181 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:18.803960 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-fb18bfcb-e679-47c0-8473-12bb8ec3e6e5 req-2e80e741-5275-41fe-9682-39cd14a46c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e944779f-4589-42ae-9de4-95c27db55bda", "name": "network-vif-plugged", "status": "completed", "tag": "62fee7db-47a8-40e5-8d05-015c16397921"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:18.805430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:18.805430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:18.813224 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-fb18bfcb-e679-47c0-8473-12bb8ec3e6e5 req-2e80e741-5275-41fe-9682-39cd14a46c9d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:18.813668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-fb18bfcb-e679-47c0-8473-12bb8ec3e6e5 req-2e80e741-5275-41fe-9682-39cd14a46c9d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:18.825911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-fb18bfcb-e679-47c0-8473-12bb8ec3e6e5 req-2e80e741-5275-41fe-9682-39cd14a46c9d service nova] Creating event network-vif-plugged:62fee7db-47a8-40e5-8d05-015c16397921 for instance e944779f-4589-42ae-9de4-95c27db55bda on hv-cinder-76015 Sep 15 04:28:18.830599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-fb18bfcb-e679-47c0-8473-12bb8ec3e6e5 req-2e80e741-5275-41fe-9682-39cd14a46c9d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.207607 Sep 15 04:28:18.831390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 391/745] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:19.195600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:19.196297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:19.197472 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:19.198163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:19.202797 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.203294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.203945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.204072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.204390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.204500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.205154 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.205591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.382962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:19.385537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:19.390320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-264f7815-f1a5-40ac-88cd-fc27b7d390ff tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.199283 Sep 15 04:28:19.390974 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 355/746] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:19 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:19.392837 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9136f107-c822-4aaa-9683-d702e4343379 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.199241 Sep 15 04:28:19.393552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 392/747] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:19 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:19.396579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:19.397263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:19.402857 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.403405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.404177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.404609 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.509723 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:19.510749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:19.516447 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.516893 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.517655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.518090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.524816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:19.531971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-10690878-9a1f-499f-be1e-c73dccdc36c9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.139946 Sep 15 04:28:19.532669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 356/748] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:19 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:19.553055 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:19.554004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:19.559769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.560218 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.560978 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:19.561411 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:19.632515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4625b709-fd80-4fab-8e75-2cc8aac46119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28470 microversion: 2.1 time: 0.126181 Sep 15 04:28:19.633359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 393/749] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:19 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28470 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:28:19.674491 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ac1379d3-2116-4eab-a9ee-16bbd701df14 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28471 microversion: 2.20 time: 0.125046 Sep 15 04:28:19.675121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 357/750] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:19 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28471 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:20.413194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:20.414085 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:20.422950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.423438 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.424212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.424555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:20.425021 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.426441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:20.434306 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.435059 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.436320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.437393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.612906 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:20.620721 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-63d0d59d-d568-4394-859f-496a160cc42d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.215119 Sep 15 04:28:20.621285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 394/751] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:20 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:20.627457 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:20.631800 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:20.632417 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:20.635094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-af034fa5-5e73-4bbe-b2fb-3fb9679c5a2a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1266 microversion: 2.1 time: 0.227208 Sep 15 04:28:20.635703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 358/752] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:20 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:20.638480 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.638937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.639756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.640197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.648226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:20.649132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:20.654710 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.655205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.655977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.656415 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.723906 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ec417cfc-0092-412b-a0f5-223c6c608374 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28470 microversion: 2.1 time: 0.078846 Sep 15 04:28:20.724791 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 359/753] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:20 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28470 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:20.729830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:20.730815 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:20.737352 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.737811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.739225 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.739682 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.760983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:20.768474 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-425cbba4-01f8-4847-bc1c-cfdb8f5b7746 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.140237 Sep 15 04:28:20.769031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 395/754] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:20 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:20.828774 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c9edd01d-e27c-4206-93ec-a3ecf67590bb tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28471 microversion: 2.20 time: 0.102638 Sep 15 04:28:20.829326 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 360/755] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:20 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28471 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:20.844827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-6b513d33-6fc1-4741-9488-045ab2b4d8d2 req-8505ea02-2ef7-4bcb-b232-38af5a0f2a4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "name": "network-vif-plugged", "status": "completed", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:20.846415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:20.846415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:20.854403 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-6b513d33-6fc1-4741-9488-045ab2b4d8d2 req-8505ea02-2ef7-4bcb-b232-38af5a0f2a4d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:20.854847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-6b513d33-6fc1-4741-9488-045ab2b4d8d2 req-8505ea02-2ef7-4bcb-b232-38af5a0f2a4d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:20.865881 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-6b513d33-6fc1-4741-9488-045ab2b4d8d2 req-8505ea02-2ef7-4bcb-b232-38af5a0f2a4d service nova] Creating event network-vif-plugged:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:28:20.870591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-6b513d33-6fc1-4741-9488-045ab2b4d8d2 req-8505ea02-2ef7-4bcb-b232-38af5a0f2a4d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029270 Sep 15 04:28:20.871166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 396/756] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:21.637516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:21.638206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:21.644722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.645167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.645926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.646392 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.652257 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:21.652953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:21.658765 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.659266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.660091 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.660727 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.828087 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:21.832821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:21.835400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6eee36d7-51f9-4e49-a5a9-339eed4400cd tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1356 microversion: 2.1 time: 0.201814 Sep 15 04:28:21.836141 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 361/757] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:21 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1356 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:21.840193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8fbc3515-2069-42b0-9b92-bf40ea1d07f2 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1453 microversion: 2.1 time: 0.192296 Sep 15 04:28:21.840346 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:21.841035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 397/758] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:21 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:21.841227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:21.847818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:21.847997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.848422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:21.848894 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.849868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.850343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.854031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.854478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.855448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.855886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.956133 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9bf7eb19-491d-4819-b074-bdf0fbb2390c tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28638 microversion: 2.1 time: 0.118937 Sep 15 04:28:21.960131 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 362/759] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:21 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28638 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:21.961714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:21.962691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:21.969012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.969456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.970237 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:21.970649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:21.981515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:21.990825 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d0e3ed0d-ae32-4385-8d6b-1f8708ae8a6a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.147033 Sep 15 04:28:21.991513 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 398/760] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:21 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:22.002226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:22.002830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:22.008600 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.009090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.009851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.010283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.058472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a331ae4a-9387-4462-b998-08e07fbba82b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28639 microversion: 2.20 time: 0.100244 Sep 15 04:28:22.059170 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 363/761] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:21 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28639 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:22.139331 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:22.146671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fa01f471-daf3-4d99-9697-d88022ca2c93 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1453 microversion: 2.1 time: 0.154159 Sep 15 04:28:22.147194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 399/762] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:21 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:22.852386 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:22.853104 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:22.859926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.860506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.861387 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.861870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.967478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:22.969030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:22.975651 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.976099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.976874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:22.977308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:22.986129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:22.994182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9ba9dfe8-5f4b-4851-a9c2-ee7461781069 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1546 microversion: 2.1 time: 0.145904 Sep 15 04:28:22.994955 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 364/763] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:22 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1546 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:23.010319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:23.011076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:23.017070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.017590 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.018433 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.018935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.054608 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d9cf158b-2e38-46a8-9ee9-0f9a6b405699 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28638 microversion: 2.1 time: 0.090446 Sep 15 04:28:23.058442 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 400/764] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:22 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:28:23.064020 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:23.064845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:23.072091 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.072537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.073313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.073758 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.176500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:23.184087 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6971d16f-9de4-48ae-8ae9-bafa9df81ade tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1546 microversion: 2.1 time: 0.177375 Sep 15 04:28:23.184873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 365/765] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:23 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1546 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:23.189283 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:23.190180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:23.199079 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.199317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.200020 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.200451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.234944 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:23.243792 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-411c1c74-7b64-475f-ac00-7c91bee3eebc tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.184088 Sep 15 04:28:23.244388 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 401/766] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:23 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:23.248527 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:23.251775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:23.251775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:23.252749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:23.253482 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Searching by: {'deleted': False, 'project_id': '9e4045049beb4f7b999e66c393eb47a2'} {{(pid=108182) get_all /opt/stack/nova/nova/compute/api.py:2905}} Sep 15 04:28:23.260429 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.260906 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.261701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.262458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.271882 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ac0317a1-317d-407f-965d-39a1c9dbef3e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28639 microversion: 2.20 time: 0.085948 Sep 15 04:28:23.273194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 366/767] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:23 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28639 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:23.355579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.multi_cell_list [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108182) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 15 04:28:23.454712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-17878cec-b398-4ccf-a042-2a02e431f202 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.209285 Sep 15 04:28:23.455347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 402/768] 10.222.0.37 () {58 vars in 1125 bytes} [Wed Sep 15 04:28:23 2021] GET /compute/v2.1/servers => generated 342 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:23.466380 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:23.467068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:23.474113 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.474556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.475350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:23.475785 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:23.597373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:23.605394 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9af71dab-573d-4cdd-a0fa-00138efaddea tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1546 microversion: 2.1 time: 0.142975 Sep 15 04:28:23.605958 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 367/769] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:23 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1546 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:24.067857 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:24.068780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:24.069707 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-41b1ed0c-802d-41ce-9cc4-c54b65857ef1 req-0ab47517-66b9-4f0f-a765-3816a68ce7ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e944779f-4589-42ae-9de4-95c27db55bda", "tag": "62fee7db-47a8-40e5-8d05-015c16397921"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:24.072423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:24.072423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:28:24.075255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.075921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.076706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.077308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.079890 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-41b1ed0c-802d-41ce-9cc4-c54b65857ef1 req-0ab47517-66b9-4f0f-a765-3816a68ce7ab service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.080341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-41b1ed0c-802d-41ce-9cc4-c54b65857ef1 req-0ab47517-66b9-4f0f-a765-3816a68ce7ab service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.091893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-41b1ed0c-802d-41ce-9cc4-c54b65857ef1 req-0ab47517-66b9-4f0f-a765-3816a68ce7ab service nova] Creating event network-changed:62fee7db-47a8-40e5-8d05-015c16397921 for instance e944779f-4589-42ae-9de4-95c27db55bda on hv-cinder-76015 Sep 15 04:28:24.096841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-41b1ed0c-802d-41ce-9cc4-c54b65857ef1 req-0ab47517-66b9-4f0f-a765-3816a68ce7ab service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 Sep 15 04:28:24.097663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 368/770] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:24.157057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-93ec1028-c1a2-4b30-b26b-0712d84d88db tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28638 microversion: 2.1 time: 0.093357 Sep 15 04:28:24.157838 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 403/771] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:24 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28638 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:24.261672 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:24.263009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:24.268820 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.269296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.270625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.271199 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.285110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:24.286836 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:24.295588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.297851 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.300740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:24.301355 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:24.384976 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-81c156ab-cca9-48c0-bcda-3ff3e3d07fde tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28639 microversion: 2.20 time: 0.103778 Sep 15 04:28:24.386400 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 404/772] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:24 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28639 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:24.411341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:24.421651 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-603fc773-4fe2-411f-b0cc-6e92aa76023d tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.164307 Sep 15 04:28:24.422345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 369/773] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:24 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:25.168460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd3c4d0f-b93a-444e-8204-85ee407266c1"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:25.168992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:25.169587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:25.169837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:25.176561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.176805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.177003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.177260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.177769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.178027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.178196 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.178462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.266766 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-95cf79ee-90e7-423f-8951-dbf33435ec66 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 28759 microversion: 2.1 time: 0.101266 Sep 15 04:28:25.267445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 370/774] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:25 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 28759 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:28:25.397859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:25.398929 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:25.405873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.406575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.407585 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.408178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.412789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-884b063f-ed3c-4db5-b2bd-e9a3a031cf53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248119 Sep 15 04:28:25.413409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 405/775] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:28:25 2021] POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:25.447395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:25.448485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:25.455351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.455807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.456595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:25.458554 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:25.512594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-df1f7240-dc18-436f-a6e0-ff951b68f205 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 28758 microversion: 2.20 time: 0.119705 Sep 15 04:28:25.513294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 371/776] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:25 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 28758 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:25.595588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:25.603604 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0bbfae1a-70cf-432b-8f5c-8ed1a0446644 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.169329 Sep 15 04:28:25.604177 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 406/777] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:25 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:26.278889 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:26.279949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:26.286510 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.286964 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.287768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.288235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.363922 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9578a6e7-7dd3-49d4-b0aa-0532bbe953dd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 30558 microversion: 2.1 time: 0.088258 Sep 15 04:28:26.364868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 372/778] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:26 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 30558 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:26.524891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:26.525857 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:26.531940 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.532330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.533105 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.533531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.616592 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b5eff811-8e4e-443f-886e-51de819ee70c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 30616 microversion: 2.20 time: 0.095258 Sep 15 04:28:26.617414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 407/779] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:26 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 30616 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:26.621107 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:26.621803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:26.629536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.629980 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.630749 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:26.631294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:26.773427 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:26.780913 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2085420d-c007-4770-80a0-1e309d530db7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.164204 Sep 15 04:28:26.781488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 373/780] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:26 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:27.376634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:27.377621 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:27.384629 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.385081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.385856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.386312 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.469862 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-116ea71c-9e39-4379-a324-83ffa29b6e7e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 32112 microversion: 2.1 time: 0.097242 Sep 15 04:28:27.470489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 408/781] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:27 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 32112 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:27.627520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:27.628350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:27.634389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.634834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.635624 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.636053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.729523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6b338f5a-e1d2-4402-8d30-fb3524f05cab tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 32304 microversion: 2.20 time: 0.105600 Sep 15 04:28:27.730137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 374/782] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:27 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 32304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:27.799022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:27.799747 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:27.806184 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.806631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.807429 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:27.807871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:27.934680 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:27.942556 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b53d8540-e3f8-4f38-8b62-b8c810a9d6d0 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.147527 Sep 15 04:28:27.943124 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 409/783] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:27 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:28.481935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:28.482926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:28.489940 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.490391 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:28.491180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.491622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:28.574404 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-44651ac5-7696-4d0e-bd5d-7598c329ca02 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 33275 microversion: 2.1 time: 0.096658 Sep 15 04:28:28.575021 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 375/784] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:28 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 33275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:28.741542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:28.742438 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:28.748225 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.748666 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:28.749422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.749850 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:28.823065 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c45a5ecf-dedd-46a2-9609-b961d3aa9cf5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 33297 microversion: 2.20 time: 0.085650 Sep 15 04:28:28.823704 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 410/785] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:28 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 33297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:28.959078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:28.959816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:28.966375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.966813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:28.967592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:28.968028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:29.087009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:29.094282 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2f269824-b759-4590-8efb-cb7d9ee1a6d6 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.139169 Sep 15 04:28:29.094834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 376/786] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:28 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:29.586979 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:29.587988 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:29.594285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:29.594732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:29.595520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:29.595953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:29.677295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0487c0a0-7853-4588-8335-91b3e4e2a6fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 34195 microversion: 2.1 time: 0.094099 Sep 15 04:28:29.681294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 411/787] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:29 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 34195 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:29.834510 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:29.835471 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:29.841213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:29.841659 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:29.842436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:29.842884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:29.922515 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bb7dd6ac-1bb7-46c9-8aa0-7edceef472c0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 34133 microversion: 2.20 time: 0.092066 Sep 15 04:28:29.923617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 377/788] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:29 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 34133 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:30.112415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:30.113777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:30.120394 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.120856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:30.121792 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.122240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:30.245035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:30.252302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-765bf059-2d7c-47a1-be55-de23af1ec80c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.143986 Sep 15 04:28:30.252869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 412/789] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:30 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:30.689722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:30.690710 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:30.698277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.698727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:30.699521 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.699961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:30.785206 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-e740984c-fc53-4430-82f2-54b3d56dcba1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 35083 microversion: 2.1 time: 0.099618 Sep 15 04:28:30.785842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 378/790] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:30 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 35083 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:30.934228 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:30.935159 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:30.942483 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.942483 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:30.943186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:30.943637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.027779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4012e3ce-ded6-4f6e-8d3a-247b63f8322d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 35107 microversion: 2.20 time: 0.097039 Sep 15 04:28:31.028381 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 413/791] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:30 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 35107 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:31.269988 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:31.270709 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:31.277096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.277539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.278304 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.278734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.402028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:31.414558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-80147536-ffa0-4344-8236-e4962ed37cef tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.148440 Sep 15 04:28:31.415408 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 379/792] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:31 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:31.797645 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:31.799047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:31.805956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.806414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.807326 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:31.807909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:31.889818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-87980452-4c63-4d5a-88d8-41c20ba20456 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 35771 microversion: 2.1 time: 0.096391 Sep 15 04:28:31.890462 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 414/793] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:31 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 35771 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:32.039519 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:32.040513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:32.047198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.047648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.048414 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.048845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.135904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5cf8edd0-5662-4d78-aad4-28316a18b019 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 35892 microversion: 2.20 time: 0.099805 Sep 15 04:28:32.136682 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 380/794] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:32 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 35892 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:32.432255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:32.432969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:32.439681 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.440138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.441556 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.442016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.560566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:32.568847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-21b3a740-95f6-4300-9a34-06229e01a147 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1569 microversion: 2.1 time: 0.140629 Sep 15 04:28:32.569417 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 415/795] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:32 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1569 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:32.585821 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:32.586476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:32.592964 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.593418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.594186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.594874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.665776 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b4c4297c-e40c-488d-a35d-a4e1feaabf6b tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "POST /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d/action" status: 202 len: 0 microversion: 2.1 time: 0.084592 Sep 15 04:28:32.666373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 381/796] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:32 2021] POST /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:32.674101 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:32.674712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:32.680556 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.681002 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.681763 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.682195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.809476 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:32.817901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f913f842-7ee6-4bf9-b48c-1f58fb11cb8a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1577 microversion: 2.1 time: 0.147345 Sep 15 04:28:32.818571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 416/797] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:32 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:32.901520 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:32.902491 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:32.908778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.909296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.910425 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:32.910838 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:32.989396 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1ffb6bba-7902-427a-a43d-66b6f32589b8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 36895 microversion: 2.1 time: 0.091274 Sep 15 04:28:32.990920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 382/798] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:32 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 36895 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:33.009594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:33.010212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:33.016205 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.016659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:33.017445 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.017889 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:33.149363 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:33.150409 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:33.156517 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:33.157324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.157778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:33.158634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.159072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:33.164520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1e70e1e7-a3e2-4d53-8181-adb309fb3ef0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1592 microversion: 2.1 time: 0.158547 Sep 15 04:28:33.165087 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 417/799] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:33 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1592 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:33.252419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3bdc0a46-b1fd-42cd-ad14-9541169b96e1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 37096 microversion: 2.20 time: 0.106920 Sep 15 04:28:33.253764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 383/800] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:33 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 37096 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:33.835003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:33.835404 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:33.841320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.841777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:33.842557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:33.843002 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:34.000745 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:34.001928 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:34.009316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:34.009977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:34.010763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:34.012028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:34.080229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:34.087262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6e4cc528-d091-414e-8e76-d90600132eb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 38014 microversion: 2.1 time: 0.090517 Sep 15 04:28:34.087910 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 384/801] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:33 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 38014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:28:34.088242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3154786b-c2f0-4ad5-a460-3ecba863ead9 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1519 microversion: 2.1 time: 0.258017 Sep 15 04:28:34.091625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 418/802] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:33 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1519 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:34.267067 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:34.268091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:34.275379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:34.275839 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:34.276616 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:34.277054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:34.357338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bf92f0d8-2759-47e7-8474-acc2c7516300 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 38109 microversion: 2.20 time: 0.094222 Sep 15 04:28:34.358323 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 385/803] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:34 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 38109 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:35.101115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:35.102942 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:35.106326 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:35.107218 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:35.109904 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.110637 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.111703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.112363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.114384 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.114843 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.115663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.116476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.204473 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b8cf6f12-2f2f-47fb-9512-8abf6343d70b tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 38158 microversion: 2.1 time: 0.108565 Sep 15 04:28:35.209386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 419/804] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:35 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 38158 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 15 04:28:35.299471 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:35.308407 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b49c43b4-502b-4caa-836c-9f0e798c7194 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.206321 Sep 15 04:28:35.318714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-23895cf7-86d7-4fb2-84eb-88abc011a0d6 req-d1f1f8b5-31f0-4e32-a6d5-08be7945796a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:35.318714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:35.318714 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:35.319965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 386/805] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:35 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:35.320183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-23895cf7-86d7-4fb2-84eb-88abc011a0d6 req-d1f1f8b5-31f0-4e32-a6d5-08be7945796a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.320786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-23895cf7-86d7-4fb2-84eb-88abc011a0d6 req-d1f1f8b5-31f0-4e32-a6d5-08be7945796a service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.335216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-23895cf7-86d7-4fb2-84eb-88abc011a0d6 req-d1f1f8b5-31f0-4e32-a6d5-08be7945796a service nova] Creating event network-changed:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:28:35.340469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-23895cf7-86d7-4fb2-84eb-88abc011a0d6 req-d1f1f8b5-31f0-4e32-a6d5-08be7945796a service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115348 Sep 15 04:28:35.341526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 420/806] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:35.370534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:35.371918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:35.378556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.379577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.381333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:35.381874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:35.476127 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3f3f55ea-1570-4cf2-95c8-17b09db05ae3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 38190 microversion: 2.20 time: 0.109249 Sep 15 04:28:35.481205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 387/807] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:35 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 38190 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:36.216799 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:36.217788 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:36.224708 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.225163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.226126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.226571 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.264452 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-387494502"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:36.265062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:36.272615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.273149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.273933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.274374 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.291994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e12e5a2e-d2ae-426b-ba1c-e8e7bec89e13 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 38158 microversion: 2.1 time: 0.079077 Sep 15 04:28:36.293193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 421/808] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:36 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 38158 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:36.326090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:36.326786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:36.333785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.334229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.335002 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.335477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.422643 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.network.security_group_api [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Adding security group 6727cbe6-a634-4825-bab9-1d5d24562fd4 to port ac25283a-c913-45da-bd98-4e9f750d269c Sep 15 04:28:36.529341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:36.537757 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-23d0ca4c-35e5-42f5-8fc3-8ad673687659 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.215632 Sep 15 04:28:36.538583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 422/809] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:36 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:36.543215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-31febc6f-56de-4086-a7dd-017f29e081d4 req-a8fdf22b-5071-41c6-ae3c-9c991bbc2a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "name": "network-vif-unplugged", "status": "completed", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:36.544820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:36.544820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:36.552259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-31febc6f-56de-4086-a7dd-017f29e081d4 req-a8fdf22b-5071-41c6-ae3c-9c991bbc2a18 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.552824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-31febc6f-56de-4086-a7dd-017f29e081d4 req-a8fdf22b-5071-41c6-ae3c-9c991bbc2a18 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.565921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-31febc6f-56de-4086-a7dd-017f29e081d4 req-a8fdf22b-5071-41c6-ae3c-9c991bbc2a18 service nova] Creating event network-vif-unplugged:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:28:36.570983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-31febc6f-56de-4086-a7dd-017f29e081d4 req-a8fdf22b-5071-41c6-ae3c-9c991bbc2a18 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031018 Sep 15 04:28:36.571743 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 423/810] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:36.576977 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:36.578022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:36.584572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.585023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.585798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.586237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.651955 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0d2cf81e-8a09-41a1-bf3d-d9ed1053b4cd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 38190 microversion: 2.20 time: 0.078748 Sep 15 04:28:36.652619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 424/811] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:36 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 38190 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:36.804908 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a8a7e2c3-6ef3-4c1f-bead-5ae81797d69d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action" status: 202 len: 0 microversion: 2.1 time: 0.541712 Sep 15 04:28:36.808853 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 388/812] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:36 2021] POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:36.814427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:36.815163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:36.827585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.828437 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.828827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:36.829259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:36.965169 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:36.978363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c2503f72-c3f7-49b6-9fee-e94ba30d966c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1755 microversion: 2.1 time: 0.168170 Sep 15 04:28:36.978856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 425/813] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:36 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:28:37.304817 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:37.305828 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:37.311577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.312036 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.313062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.313498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.355973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-5aeb21d6-3b8c-453b-b301-0cb9194cdd31 req-9e6388d2-f938-45df-96f1-1988ebf10ffa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:37.357655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:37.357655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:37.365153 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5aeb21d6-3b8c-453b-b301-0cb9194cdd31 req-9e6388d2-f938-45df-96f1-1988ebf10ffa service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.365677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-5aeb21d6-3b8c-453b-b301-0cb9194cdd31 req-9e6388d2-f938-45df-96f1-1988ebf10ffa service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.377215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-5aeb21d6-3b8c-453b-b301-0cb9194cdd31 req-9e6388d2-f938-45df-96f1-1988ebf10ffa service nova] Creating event network-changed:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:28:37.383551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-5aeb21d6-3b8c-453b-b301-0cb9194cdd31 req-9e6388d2-f938-45df-96f1-1988ebf10ffa service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031334 Sep 15 04:28:37.384561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 426/814] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:37.385140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-479ccb14-37b2-4be0-b577-c829034c2985 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action" status: 200 len: 38289 microversion: 2.1 time: 0.084450 Sep 15 04:28:37.387004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 389/815] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:28:37 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/action => generated 38289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:37.397077 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:37.397768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:37.404681 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.405216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.406107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.406556 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.430786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-74baa84b-5e7b-458c-8878-d09cfa0ea04d tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/ips" status: 200 len: 145 microversion: 2.1 time: 0.038492 Sep 15 04:28:37.431401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 427/816] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:28:37 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:37.556665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:37.557499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:37.564878 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.565519 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.567631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.568074 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.668514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:37.670349 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:37.690253 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.691664 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.692614 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.693138 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.720023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:37.728665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-08426d6e-2a03-4749-b906-544ccbdf2d28 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.176120 Sep 15 04:28:37.729501 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 390/817] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:37 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:37.773146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-da7c2b0d-bd90-404b-9c49-00bdf8b61145 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 200 len: 38333 microversion: 2.20 time: 0.113731 Sep 15 04:28:37.774006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 428/818] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:37 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 38333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:37.784024 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:37.785229 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:37.791426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.791898 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.792712 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:37.793150 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:37.817618 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9a4aa761-3bbe-427c-ae0a-312851f54f23 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/ips" status: 200 len: 151 microversion: 2.20 time: 0.037445 Sep 15 04:28:37.818105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 391/819] 10.222.0.37 () {60 vars in 1289 bytes} [Wed Sep 15 04:28:37 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:28:38.746626 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:38.747345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:38.753915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:38.754355 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:38.755357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:38.755760 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:38.807845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf77c7f7-fd89-41b9-9ee9-ad0550852a92"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:38.808895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:38.815727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:38.816231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:38.817004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:38.817443 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:38.876569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:38.883967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ba3806d2-9ba4-4870-ba29-82f484b8f5a4 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.141353 Sep 15 04:28:38.884532 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 429/820] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:38 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:39.048334 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4a483ff1-a839-49c7-9082-35976b361a99 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.244068 Sep 15 04:28:39.048924 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 392/821] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:28:38 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 194 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:39.900823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:39.901367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:39.907717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:39.908167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:39.908920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:39.909603 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:39.970257 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:39.970997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:39.977594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:39.978044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:39.978827 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:39.979302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:40.003068 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lazy-loading 'flavor' on Instance uuid beeb1b79-9490-4cb0-bea1-10bc320f53be {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:28:40.031082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:40.039022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6f09b73c-0572-4d81-a8da-0cc7baade36e tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.141837 Sep 15 04:28:40.039635 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 430/822] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:39 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:40.282848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d467667e-014a-4f75-ade6-5d96736daa99 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 202 len: 0 microversion: 2.20 time: 0.317027 Sep 15 04:28:40.283689 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 393/823] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:28:39 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 15 04:28:40.291891 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:40.292502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:40.298318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:40.298857 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:40.299941 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:40.301074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:40.425770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:40.433447 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:40.434958 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:40.436279 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-39dfcc36-55b8-41eb-9766-933c15cc5e62 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.148108 Sep 15 04:28:40.436835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 431/824] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:40 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:41.056511 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:41.057207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:41.063552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:41.063941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:41.064697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:41.065134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:41.194841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:41.202239 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fd441f8b-d2c2-4418-a567-6c3188060135 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.149949 Sep 15 04:28:41.202802 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 394/825] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:41 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:41.456959 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:41.457561 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:41.465410 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:41.465928 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:41.466724 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:41.467193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:41.590818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:41.599062 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:41.600589 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:41.601779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ea4534b8-7690-49c0-91fa-e9702be2d67b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.150167 Sep 15 04:28:41.602346 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 432/826] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:41 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:42.219483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:42.220098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:42.227542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:42.227990 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:42.228769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:42.229207 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:42.353117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:42.360385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5538a607-f7c6-4ae2-9c41-b32b895fb373 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1575 microversion: 2.1 time: 0.144549 Sep 15 04:28:42.360982 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 395/827] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:42 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:42.619506 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:42.620102 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:42.626221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:42.626662 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:42.627460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:42.627895 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:42.745573 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:42.753910 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:42.755606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:42.756767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9633c8ce-7cac-46b4-8cf0-69faa6940007 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.140966 Sep 15 04:28:42.757328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 433/828] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:42 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:43.377490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:43.378247 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:43.384017 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:43.384472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:43.385247 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:43.385687 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:43.503865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:43.511036 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ebac1c6c-6c7e-4196-87aa-8ea7e00b0444 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1562 microversion: 2.1 time: 0.137512 Sep 15 04:28:43.511632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 396/829] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:28:43 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1562 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:28:43.775801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:43.776403 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:43.782045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:43.782497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:43.783282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:43.783719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:43.906584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:43.914847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:43.916390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:43.917606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b92ec041-a6a3-4baf-94e7-b01db9b45242 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.145712 Sep 15 04:28:43.918166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 434/830] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:43 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:44.558728 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-8acb7a99-04b1-4a1d-bb16-a633c5457a75 req-efc017c4-650b-4772-ba2e-e789bf2ffb39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "name": "network-vif-plugged", "status": "completed", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:44.560321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:44.560321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:28:44.567864 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-8acb7a99-04b1-4a1d-bb16-a633c5457a75 req-efc017c4-650b-4772-ba2e-e789bf2ffb39 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:44.568459 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-8acb7a99-04b1-4a1d-bb16-a633c5457a75 req-efc017c4-650b-4772-ba2e-e789bf2ffb39 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:44.580312 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-8acb7a99-04b1-4a1d-bb16-a633c5457a75 req-efc017c4-650b-4772-ba2e-e789bf2ffb39 service nova] Creating event network-vif-plugged:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:28:44.585104 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-8acb7a99-04b1-4a1d-bb16-a633c5457a75 req-efc017c4-650b-4772-ba2e-e789bf2ffb39 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029969 Sep 15 04:28:44.585689 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 397/831] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:44.935920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:44.936890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:44.943622 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:44.944068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:44.945318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:44.945820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:45.067728 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:45.075514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:45.077023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:45.078175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-11e6e8a6-3470-4cb0-9b77-025b82b0e71a tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.146580 Sep 15 04:28:45.078733 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 435/832] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:44 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:28:46.098358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:46.099063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:46.105095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.105547 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.106313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.106750 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.227584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:46.235182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:46.236679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:46.238456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a27f7a55-efee-40ab-87d8-acc1865abeb1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.144673 Sep 15 04:28:46.239033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 398/833] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:46 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:46.568680 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:46.569654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:46.575558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.576015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.576797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.577231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.606160 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e246c980-014b-403c-a3b3-c2451633a5f0 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041604 Sep 15 04:28:46.606711 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 436/834] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:28:46 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:46.616317 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:46.616814 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:46.622556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.622995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.623799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:46.624226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:46.652395 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-42118aea-d8c9-4e6c-b1e3-aad228aeb946 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92" status: 200 len: 194 microversion: 2.1 time: 0.039773 Sep 15 04:28:46.652955 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 399/835] 10.222.0.37 () {58 vars in 1413 bytes} [Wed Sep 15 04:28:46 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:47.256820 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:47.257436 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:47.263687 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:47.264143 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:47.264914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:47.265351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:47.387173 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:47.394709 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:47.396228 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:47.397374 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d3eb424b-aa04-4ece-882d-27b86f06dca7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.144900 Sep 15 04:28:47.397918 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 437/836] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:47 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:47.960866 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b2aac85-4247-49ee-9cbe-574d16ba58d7"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:47.961984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:47.967743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:47.968184 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:47.968940 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:47.969377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:48.196662 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b73a75c0-4ec1-409e-b3f1-8ee10842e331 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.240058 Sep 15 04:28:48.197263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 400/837] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:28:47 2021] POST /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:48.415297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:48.415915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:48.421801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:48.422252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:48.423073 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:48.423495 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:48.541801 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:48.549646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:48.551192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:48.552341 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bde87f36-0ce4-4df1-92d2-cafe57738d7b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.140815 Sep 15 04:28:48.552911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 438/838] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:48 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:28:49.570638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:49.571415 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:49.577401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:49.577854 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:49.578625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:49.579063 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:49.701198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:49.709746 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:49.711280 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:49.712444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-24ba71e1-b37f-4451-a455-a17d34e0ba50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.146356 Sep 15 04:28:49.713005 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 401/839] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:49 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:50.730827 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:50.731487 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:50.737917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:50.738489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:50.739291 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:50.739735 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:50.858802 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:50.866625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:50.868142 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:50.869283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9bd28ead-6875-4882-a1ed-985e55400e41 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.142163 Sep 15 04:28:50.869834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 439/840] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:50 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:28:51.886868 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:51.887444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:51.893740 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:51.894196 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:51.894972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:51.895446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:52.013553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:52.021143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:52.022637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:52.023805 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-22332437-c758-4bd6-aa74-e39b4c157982 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.140729 Sep 15 04:28:52.024359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 402/841] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:51 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:53.042533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:53.043228 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:53.049160 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:53.049608 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:53.050371 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:53.050810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:53.168952 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:53.177640 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:53.179162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:53.180314 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-972db8ee-d30e-408b-90af-1ed7fe09c973 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.142358 Sep 15 04:28:53.180878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 440/842] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:53 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:54.199920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:54.200645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:54.206349 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:54.207612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:54.208539 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:54.208984 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:54.336086 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:54.343612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:54.345094 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:54.346237 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-95867eeb-6a9d-4672-be9e-1bf8e785f01b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.150148 Sep 15 04:28:54.346795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 403/843] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:54 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:28:55.364145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:55.364747 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:55.370920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:55.371406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:55.372168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:55.372601 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:55.496821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:55.504782 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:55.506297 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:55.507503 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-abc734bb-487b-45de-9c5c-3ba91cb3a41b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.147228 Sep 15 04:28:55.508060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 441/844] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:55 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:55.711511 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:55.712470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:55.718121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:55.718607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:55.719502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:55.719937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:55.749662 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b98b03f7-b66c-439c-bdde-e92dcc8c5791 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042331 Sep 15 04:28:55.750324 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 404/845] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:28:55 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:56.125926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:56.126421 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:56.133204 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.133660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.134440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.135113 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.164677 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f93746b2-8b88-4ec9-ad5c-fc21401ec100 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92" status: 200 len: 194 microversion: 2.1 time: 0.042506 Sep 15 04:28:56.165258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 442/846] 10.222.0.37 () {58 vars in 1413 bytes} [Wed Sep 15 04:28:56 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:56.174621 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:56.175117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:56.183979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.184553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.185631 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.186406 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.276581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lazy-loading 'services' on Instance uuid 561a3419-fa52-4814-bb17-5983d70b6324 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:28:56.340169 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-16005720-2580-4a64-a393-afbfd8024bbd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92" status: 202 len: 0 microversion: 2.1 time: 0.169107 Sep 15 04:28:56.340743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 405/847] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:28:56 2021] DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/bf77c7f7-fd89-41b9-9ee9-ad0550852a92 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:28:56.525145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:56.525873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:56.531586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.532110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.532954 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:56.533461 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:56.655019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:56.663479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:56.664997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:56.666175 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2563de3c-55cd-4672-82b6-83677153d186 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1744 microversion: 2.20 time: 0.144838 Sep 15 04:28:56.666736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 443/848] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:56 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1744 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:57.685654 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:57.686313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:57.693137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:57.693583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:57.694345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:57.694774 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:57.816493 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:57.824904 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:57.826403 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:57.827617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fcbd6507-9623-4461-9972-acb8eb05177c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1744 microversion: 2.20 time: 0.146187 Sep 15 04:28:57.828173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 406/849] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:57 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1744 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:28:58.516032 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:58.516594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:58.522533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.523055 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.523925 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.524362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.560642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-604aaabd-a773-4a0d-9a25-15cafc64b5fe tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/5b2aac85-4247-49ee-9cbe-574d16ba58d7" status: 200 len: 194 microversion: 2.1 time: 0.048247 Sep 15 04:28:58.563834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 444/850] 10.222.0.37 () {58 vars in 1413 bytes} [Wed Sep 15 04:28:58 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/5b2aac85-4247-49ee-9cbe-574d16ba58d7 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:28:58.571734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:58.572258 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:58.578294 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.578736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.579552 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.579991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.648679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-49c53608-aaf6-4980-b4af-f3613d677098 req-037e7cb0-60f5-454a-a2f6-b7e354ca5164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "name": "network-vif-plugged", "status": "completed", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:28:58.650538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:28:58.650538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:28:58.659736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-49c53608-aaf6-4980-b4af-f3613d677098 req-037e7cb0-60f5-454a-a2f6-b7e354ca5164 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.660216 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-49c53608-aaf6-4980-b4af-f3613d677098 req-037e7cb0-60f5-454a-a2f6-b7e354ca5164 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.675109 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-49c53608-aaf6-4980-b4af-f3613d677098 req-037e7cb0-60f5-454a-a2f6-b7e354ca5164 service nova] Creating event network-vif-plugged:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:28:58.683183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-49c53608-aaf6-4980-b4af-f3613d677098 req-037e7cb0-60f5-454a-a2f6-b7e354ca5164 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038981 Sep 15 04:28:58.683701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lazy-loading 'services' on Instance uuid 561a3419-fa52-4814-bb17-5983d70b6324 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:28:58.684568 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 445/851] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:28:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:28:58.753799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-44eae2f1-a53d-4bc9-a1c8-14175fa1c449 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/5b2aac85-4247-49ee-9cbe-574d16ba58d7" status: 202 len: 0 microversion: 2.1 time: 0.186458 Sep 15 04:28:58.754429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 407/852] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:28:58 2021] DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments/5b2aac85-4247-49ee-9cbe-574d16ba58d7 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:28:58.846011 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:58.847434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:58.854819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.855118 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.856012 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:58.856520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:58.980868 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:58.989597 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:58.990756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:28:58.992461 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0f9f59a5-9e0f-46ed-921c-666376dceaf3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.150430 Sep 15 04:28:59.003081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 446/853] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:28:58 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:28:59.929684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:28:59.930744 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:28:59.937194 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:59.938109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:59.939033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:28:59.939639 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:28:59.975979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-50a18661-5a88-41b0-bbfa-cdd2b6941aa3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050409 Sep 15 04:28:59.977579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 408/854] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:28:59 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:29:00.010146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:00.010835 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:00.017569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.021468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.022524 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.023159 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.178660 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:00.179759 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:00.204502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.208619 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.220296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.223683 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.273845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:00.275791 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a72dc5fa-4184-4b33-ae00-e037bcd4600e tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106774 Sep 15 04:29:00.277379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 409/855] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:29:00 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:29:00.283236 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:00.285890 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:00.288007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4de5da1c-5fa7-47cc-be85-8683b1a2b0b2 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.281272 Sep 15 04:29:00.299460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 447/856] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:00 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:00.350499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:00.351377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:00.357692 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.358130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.359187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.359778 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.386912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:29:00.497038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-999e4ccb-24c2-482f-8985-fd1d03310119 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 204 len: 0 microversion: 2.1 time: 0.149950 Sep 15 04:29:00.498900 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 410/857] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:29:00 2021] DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:29:00.512526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:00.520659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:00.543330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.546544 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.547467 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:00.547984 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:00.695755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:00.703761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-942dc36a-7a7f-44f8-9527-e4e11aa079b3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1674 microversion: 2.1 time: 0.199219 Sep 15 04:29:00.704332 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 448/858] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:00 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:01.309948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:01.311647 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:01.318592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:01.319446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:01.320598 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:01.321560 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:01.464418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:01.472522 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:01.474891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:01.476217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1a8b4686-8a68-4f22-a8a7-a8fbaa4ace57 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.173238 Sep 15 04:29:01.477379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 411/859] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:01 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:01.722041 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:01.722478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:01.729078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:01.729536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:01.730401 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:01.730752 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:01.873907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:01.887420 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ff57b332-4cb1-4f10-8e19-0671e64039cb tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1674 microversion: 2.1 time: 0.168993 Sep 15 04:29:01.897689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 449/860] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:01 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:02.495293 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:02.496618 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:02.503161 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.503629 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.504879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.505269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.667494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:02.678050 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:02.679772 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:02.681767 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2706bcc8-f697-44e5-8657-0df3c0480650 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.189607 Sep 15 04:29:02.682424 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 412/861] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:02 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:29:02.714430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:02.715815 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:02.721907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.722655 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.724337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.724991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.826545 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c6166930-7904-4920-ac9c-2959f90d8174 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action" status: 202 len: 0 microversion: 2.1 time: 0.117970 Sep 15 04:29:02.827358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 450/862] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:29:02 2021] POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:29:02.836213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:02.836837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:02.845591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.845898 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.846930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.847163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.911650 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:02.912428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:02.927428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.927810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:02.929134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:02.929134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:03.240248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:03.253265 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-55349fb7-9ed6-4226-8b82-5f9b0f1e8fb1 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1674 microversion: 2.1 time: 0.349547 Sep 15 04:29:03.256057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 451/863] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:02 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1674 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:03.354355 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:03.363209 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7f377f8c-9cad-4842-8224-1e26780fab23 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1747 microversion: 2.1 time: 0.531377 Sep 15 04:29:03.363867 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 413/864] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:02 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1747 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:03.685813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-d8f816c3-751c-4227-b27e-a0b0cbc3027b req-e88ee743-3079-4088-add0-7dd36b6905f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "561a3419-fa52-4814-bb17-5983d70b6324", "name": "network-vif-deleted", "tag": "974ea781-38b4-42bd-93ac-1ce7b9ef33c7"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:03.690168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:03.690168 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:29:03.701151 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:03.702453 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:03.728417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:03.729109 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:03.733477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:03.734408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-d8f816c3-751c-4227-b27e-a0b0cbc3027b req-e88ee743-3079-4088-add0-7dd36b6905f4 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:03.735305 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:03.735959 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-d8f816c3-751c-4227-b27e-a0b0cbc3027b req-e88ee743-3079-4088-add0-7dd36b6905f4 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:03.784454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-d8f816c3-751c-4227-b27e-a0b0cbc3027b req-e88ee743-3079-4088-add0-7dd36b6905f4 service nova] Creating event network-vif-deleted:974ea781-38b4-42bd-93ac-1ce7b9ef33c7 for instance 561a3419-fa52-4814-bb17-5983d70b6324 on hv-cinder-76015 Sep 15 04:29:03.796536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-d8f816c3-751c-4227-b27e-a0b0cbc3027b req-e88ee743-3079-4088-add0-7dd36b6905f4 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117607 Sep 15 04:29:03.799112 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 452/865] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:29:03.956840 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:03.967944 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:03.969696 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:03.970889 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c9291c56-de51-419e-8230-178ab006eea5 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.274155 Sep 15 04:29:03.971879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 414/866] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:03 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:29:04.274195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:04.275255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:04.284094 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.284803 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:04.286052 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.286748 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:04.353999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.354786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:04.357288 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lazy-loading 'fault' on Instance uuid 561a3419-fa52-4814-bb17-5983d70b6324 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:29:04.383096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:04.384098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:04.396015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.397402 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:04.410247 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.411670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:04.439448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0853786744074c74ae4b7a86f191c813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91a9aa7366104d72a142ebfb84ea383e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:04.449900 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-58f60942-0255-4986-a3d6-8c1d772d28f9 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 200 len: 1328 microversion: 2.1 time: 0.180714 Sep 15 04:29:04.452761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 453/867] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:04 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 1328 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:04.597203 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:04.609096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-62780e25-a218-48e3-80cd-2293e35f0b86 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.229708 Sep 15 04:29:04.609648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 415/868] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:04 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:04.989886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:04.991315 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:04.998078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:04.999076 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.000137 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:05.000813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.149417 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:05.159588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:05.162189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:05.163517 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-974b0b5f-992e-42cc-b979-a0ca3c878d43 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.178261 Sep 15 04:29:05.164286 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 454/869] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:04 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:05.470024 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:05.471509 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:05.480869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:05.481612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.482658 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:05.483195 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.500341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. Sep 15 04:29:05.501277 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:05.502306 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1d0c49ac-4021-4753-a1d3-23a92e786670 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 404 len: 111 microversion: 2.1 time: 0.036349 Sep 15 04:29:05.503026 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 416/870] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:05 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:29:05.512611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3aa82802-1409-4676-b262-2fdef3e586fd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '.version_select at 0x7f02a22600d0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:05.533805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3aa82802-1409-4676-b262-2fdef3e586fd tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450312213" status: 202 len: 0 microversion: 2.1 time: 0.024904 Sep 15 04:29:05.534675 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 455/871] 10.222.0.37 () {58 vars in 1221 bytes} [Wed Sep 15 04:29:05 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1450312213 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:29:05.629028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:05.629892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:05.635977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:05.636672 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.637680 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:05.638263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:05.822777 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:05.836062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0ea72318-634b-4096-a2cd-e0e736645540 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.211810 Sep 15 04:29:05.836830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 417/872] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:05 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:06.182186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:06.183605 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:06.193096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:06.194000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:06.195258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:06.195876 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:06.380484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:06.399348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:06.401956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:06.407564 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1d158194-d184-4be5-9308-55387b5cf7e3 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.229156 Sep 15 04:29:06.416277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 456/873] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:06 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:06.855657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:06.857045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:06.863439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:06.864376 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:06.865536 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:06.866214 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:07.002713 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:07.011425 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a1f3b348-bad5-4fcd-9931-58d383a1e293 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.159421 Sep 15 04:29:07.012238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 418/874] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:06 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:07.428769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:07.429448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:07.435699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:07.436155 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:07.436955 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:07.437398 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:07.608982 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:07.620569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:07.622872 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:07.624272 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-841ad561-5f4c-4e7a-a65d-3f99bd5415b0 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.200141 Sep 15 04:29:07.624924 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 457/875] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:07 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:08.028649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:08.029956 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:08.036865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.037315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.038093 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.038527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.166498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:08.174842 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3b335635-c078-461d-93e7-b168575b77b0 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.149675 Sep 15 04:29:08.175476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 419/876] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:08 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:08.646235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:08.646790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:08.652713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.653150 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.653908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.654339 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.724178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:08.724681 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:08.730356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.730813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.731633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.732053 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.745365 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. Sep 15 04:29:08.745991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:08.746794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ae97a157-f3f1-49c9-9de0-e2d601c08be3 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 404 len: 111 microversion: 2.1 time: 0.026321 Sep 15 04:29:08.747573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 420/877] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:29:08 2021] DELETE /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:29:08.755314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:08.755930 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 561a3419-fa52-4814-bb17-5983d70b6324] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:08.761795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.762226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.763013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:08.763488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:08.777247 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:08.778016 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. Sep 15 04:29:08.778618 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 561a3419-fa52-4814-bb17-5983d70b6324 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:08.779697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b1cfa71d-8c37-4f2d-9b94-5b20ab56c4f8 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324" status: 404 len: 111 microversion: 2.1 time: 0.028402 Sep 15 04:29:08.780427 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 421/878] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:08 2021] GET /compute/v2.1/servers/561a3419-fa52-4814-bb17-5983d70b6324 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:29:08.786661 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:08.788335 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:08.789377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9612089e-e69b-4046-ae7d-4f8b15a0e703 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1739 microversion: 2.20 time: 0.147822 Sep 15 04:29:08.790553 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 458/879] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:08 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1739 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:09.193015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:09.193628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:09.199465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.199921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.200723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.201158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.406687 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:09.415243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a067b1d4-2472-48c7-9fda-be14afb04f44 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.226322 Sep 15 04:29:09.415813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 422/880] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:09 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:09.807454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:09.807989 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:09.814009 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.814461 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.815256 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.815699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.913769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:09.914287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:09.920028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.920485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.921260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.921731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.934235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:09.934923 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. Sep 15 04:29:09.935547 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:09.936377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d4b441ad-3666-404f-8bce-73d61ecbe127 tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 404 len: 111 microversion: 2.1 time: 0.026855 Sep 15 04:29:09.937106 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 423/881] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:29:09 2021] DELETE /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:29:09.943676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:09.945224 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:09.945905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:09.946389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-efad1728-9314-4738-82f9-237da227dd0e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1721 microversion: 2.20 time: 0.142776 Sep 15 04:29:09.946506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] [instance: 95a894d8-561b-4dfb-9240-5df7076fcd2d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:09.946935 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 459/882] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:09 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1721 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:09.952196 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.952650 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.953424 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:09.953864 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:09.974733 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] HTTP exception thrown: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. Sep 15 04:29:09.975373 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] Returning 404 to user: Instance 95a894d8-561b-4dfb-9240-5df7076fcd2d could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:09.976210 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-486ff175-09db-4947-bbff-49f785fd90fa tempest-AttachVolumeTestJSON-1862095178 tempest-AttachVolumeTestJSON-1862095178-project] 10.222.0.37 "GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d" status: 404 len: 111 microversion: 2.1 time: 0.035131 Sep 15 04:29:09.976752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 424/883] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:09 2021] GET /compute/v2.1/servers/95a894d8-561b-4dfb-9240-5df7076fcd2d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:29:10.431187 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:10.431804 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:10.437517 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:10.438275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:10.439058 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:10.439520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:10.912001 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:10.919848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-23851133-9e04-4985-b344-7302547bb6c3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.492382 Sep 15 04:29:10.920416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 460/884] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:10 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:10.966822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:10.967469 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:10.973691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:10.974140 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:10.974911 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:10.975465 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:11.146463 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:11.161908 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:11.163449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:11.164617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b1fdc409-dfea-4d6d-81c8-2fd3c0eef80c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1721 microversion: 2.20 time: 0.201547 Sep 15 04:29:11.165354 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 425/885] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:10 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:11.936860 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:11.937469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:11.948409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:11.948409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:11.948409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:11.948409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.162015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:12.169972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8e01756b-dfb8-43ad-ba41-0995942dc954 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.236818 Sep 15 04:29:12.170744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 461/886] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:11 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:12.184488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:12.185091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:12.191408 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.192797 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.193714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.194217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.356718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:12.365651 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:12.367431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:12.368619 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-38cf47e6-bfb3-4e99-973c-b587d1c17558 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1664 microversion: 2.20 time: 0.187985 Sep 15 04:29:12.369179 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 426/887] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:12 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:12.387807 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8102f1a5-27ba-499b-a6f8-33e7a0d89c6a"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:12.388987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:12.395671 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.396200 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.396973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.397406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.683120 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-399ab84e-f0ab-4fbb-840a-5e05fcedf255 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300362 Sep 15 04:29:12.684449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 462/888] 10.222.0.37 () {62 vars in 1364 bytes} [Wed Sep 15 04:29:12 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 15 04:29:12.692811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-4b658562-f374-42c3-b66b-538776559615 req-5560f212-612d-4243-bd26-ae9ec301d027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "name": "network-vif-unplugged", "status": "completed", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:12.696382 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:12.696382 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:29:12.708020 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-4b658562-f374-42c3-b66b-538776559615 req-5560f212-612d-4243-bd26-ae9ec301d027 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.708757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-4b658562-f374-42c3-b66b-538776559615 req-5560f212-612d-4243-bd26-ae9ec301d027 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.725641 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.compute.server_external_events [req-4b658562-f374-42c3-b66b-538776559615 req-5560f212-612d-4243-bd26-ae9ec301d027 service nova] Unable to find a host for instance beeb1b79-9490-4cb0-bea1-10bc320f53be. Dropping event network-vif-unplugged {{(pid=108181) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 15 04:29:12.726527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-4b658562-f374-42c3-b66b-538776559615 req-5560f212-612d-4243-bd26-ae9ec301d027 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041391 Sep 15 04:29:12.727497 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 427/889] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:12 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 15 04:29:12.831632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:12.832717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:12.838919 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.839412 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:12.840209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:12.840646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.102149 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b00e13d2-48cb-4ebb-a50d-f1ff1cce0b83 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments/8102f1a5-27ba-499b-a6f8-33e7a0d89c6a" status: 202 len: 0 microversion: 2.20 time: 0.275194 Sep 15 04:29:13.102803 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 463/890] 10.222.0.37 () {60 vars in 1457 bytes} [Wed Sep 15 04:29:12 2021] DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments/8102f1a5-27ba-499b-a6f8-33e7a0d89c6a => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:29:13.166267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:13.166835 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:13.173075 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.173445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.174227 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.174662 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.187337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:13.188213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:13.194854 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.195616 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.196411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.196852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.265259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f9ddbfa9-bd5a-40ee-b0ed-207690d70383 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action" status: 202 len: 0 microversion: 2.20 time: 0.102693 Sep 15 04:29:13.267013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 428/891] 10.222.0.37 () {62 vars in 1319 bytes} [Wed Sep 15 04:29:13 2021] POST /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:29:13.276066 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:13.277025 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:13.284935 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.286034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.287003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:13.287902 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:13.628322 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:13.655511 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:13.657288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:13.658457 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b747a2dc-d162-477b-a367-acb3c11f3122 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1672 microversion: 2.20 time: 0.386918 Sep 15 04:29:13.670344 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 429/892] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:13 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1672 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:29:13.670439 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:13.681497 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a8639789-72e0-45e7-b2ab-295a42ecb23c tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1752 microversion: 2.1 time: 0.491241 Sep 15 04:29:13.682555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 464/893] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:13 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1752 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:29:14.677654 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:14.678561 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:14.687947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:14.687947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:14.688201 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:14.688603 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:14.698545 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:14.700599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:14.712582 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:14.717809 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:14.718841 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:14.719532 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:14.978700 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:14.984824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:14.987281 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:14.990045 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:14.991473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f7d2e853-0410-46ba-b9ed-7243699702ed tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.317835 Sep 15 04:29:14.992542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 430/894] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:14 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:15.003933 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9ab58e96-66f7-4187-afde-24570992e39d tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1755 microversion: 2.1 time: 0.309047 Sep 15 04:29:15.005276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 465/895] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:14 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1755 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:29:16.009915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:16.010524 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:16.016769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:16.017219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:16.018000 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:16.018433 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:16.169599 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:16.177747 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:16.179828 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:16.181313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-362b9bb0-5ea8-44a2-bfbe-190a31b50268 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.175216 Sep 15 04:29:16.182026 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 431/896] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:16 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:17.199693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:17.200376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:17.206310 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:17.206759 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:17.208063 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:17.208502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:17.339736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:17.347819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:17.349505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:17.350849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f82d7108-a90e-4649-be7f-56031762b757 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.154800 Sep 15 04:29:17.351574 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 466/897] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:17 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:29:18.382292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:18.383004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:18.389525 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:18.389969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:18.390779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:18.391300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:18.518018 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:18.528226 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:18.529718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:18.531549 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-86e748dc-76cf-4c2e-a839-44693e8926d9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.165619 Sep 15 04:29:18.541731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 432/898] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:18 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:19.548839 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:19.549478 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:19.556310 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:19.556762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:19.557609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:19.558045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:19.684689 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:19.693313 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:19.694786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:19.696018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-abe5631d-a7b9-4c71-9c16-d494d491eed8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.150856 Sep 15 04:29:19.696581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 467/899] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:19 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:20.714634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:20.716528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:20.725516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:20.726314 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:20.727701 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:20.728445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:20.878183 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:20.885947 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:20.887467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:20.888626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a7e0ee83-8137-4749-92cf-5d6a10209381 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.178631 Sep 15 04:29:20.889183 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 433/900] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:20 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 15 04:29:21.907505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:21.908110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:21.914997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:21.915484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:21.916256 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:21.916702 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:22.042736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:22.050515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:22.052062 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:22.053235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-aa92b589-7159-49b0-84e0-5386a6f8ea36 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.149433 Sep 15 04:29:22.054116 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 468/901] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:21 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:23.081132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:23.082430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:23.091671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:23.092129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:23.093152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:23.093804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:23.241427 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:23.248971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:23.250449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:23.251627 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3bfe237e-1f3a-4c09-a6bb-b0c8a3c5792c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.182944 Sep 15 04:29:23.252175 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 434/902] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:23 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:24.269590 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:24.270189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:24.275999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:24.276448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:24.277227 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:24.277710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:24.454844 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:24.463587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:24.465084 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:24.466250 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ec44b7bf-7cea-4a04-9eef-4b830de0ee13 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.200351 Sep 15 04:29:24.467663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 469/903] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:24 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:25.486437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:25.487100 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:25.493545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:25.493996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:25.494807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:25.495275 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:25.619743 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:25.627462 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:25.629640 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:25.630858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fb347035-6cdd-4b3b-a346-8387aed2d65d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.148726 Sep 15 04:29:25.631718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 435/904] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:25 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:26.653023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:26.654389 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:26.664404 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:26.664796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:26.665585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:26.666025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:26.787756 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:26.795390 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:26.796894 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:26.798054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-03ead40b-7881-4abc-a6e1-a554706ab7f1 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.151754 Sep 15 04:29:26.798613 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 470/905] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:26 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:27.817377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:27.817986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:27.823822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:27.824271 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:27.825028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:27.825463 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:27.948886 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:27.956578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:27.958062 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:27.959235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4411d55c-1458-44dd-9090-c2f924e3f425 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.146451 Sep 15 04:29:27.959779 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 436/906] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:27 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:28.977419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:28.978024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:28.983952 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:28.984395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:28.985165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:28.985598 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:29.117994 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:29.126290 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:29.127830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:29.129639 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-208026e1-d60e-4b08-a23e-61f0d4a2f540 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.156150 Sep 15 04:29:29.130194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 471/907] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:28 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:30.148267 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:30.148856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:30.155483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:30.155941 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:30.156714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:30.157312 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:30.285893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:30.293499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:30.294987 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:30.296154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-47c8ac7d-1982-442c-885a-945656d87b3b tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.151782 Sep 15 04:29:30.296707 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 437/908] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:30 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:30.832302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-2c4c0a43-2ae2-4b25-bc1d-131f23365d19 req-52b26ab1-5714-4f75-bf77-941b3260a44c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "name": "network-vif-plugged", "status": "completed", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:30.834039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:30.834039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:29:30.842869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2c4c0a43-2ae2-4b25-bc1d-131f23365d19 req-52b26ab1-5714-4f75-bf77-941b3260a44c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:30.843694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-2c4c0a43-2ae2-4b25-bc1d-131f23365d19 req-52b26ab1-5714-4f75-bf77-941b3260a44c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:30.855672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-2c4c0a43-2ae2-4b25-bc1d-131f23365d19 req-52b26ab1-5714-4f75-bf77-941b3260a44c service nova] Creating event network-vif-plugged:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:29:30.863972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-2c4c0a43-2ae2-4b25-bc1d-131f23365d19 req-52b26ab1-5714-4f75-bf77-941b3260a44c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Sep 15 04:29:30.864581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 472/909] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:29:31.314067 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:31.314677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:31.321110 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:31.321568 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:31.322418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:31.322865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:31.450584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:31.458264 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:31.459768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:31.460915 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6268910a-c19b-4a85-9024-a11814a0fb7d tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.150857 Sep 15 04:29:31.461470 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 438/910] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:31 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:32.479905 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:32.480608 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:32.487411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:32.488212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:32.488674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:32.489347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:32.646660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:32.656705 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:32.658376 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:32.660141 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8320b6c0-cc94-4353-9d78-1fe55fec4f27 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1730 microversion: 2.20 time: 0.183963 Sep 15 04:29:32.661489 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 473/911] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:32 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:33.678255 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:33.679016 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:33.684860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:33.685310 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:33.686080 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:33.686517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:33.813884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:33.822503 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:33.824034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:33.825222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f0342b18-02a6-4915-9392-3e654db13fe7 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1717 microversion: 2.20 time: 0.151313 Sep 15 04:29:33.836366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 439/912] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:29:33 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:29:50.103775 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-387494502"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:50.104405 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:50.110365 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:50.110813 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:50.111618 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:50.112051 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:50.255354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.network.security_group_api [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Removing security group 6727cbe6-a634-4825-bab9-1d5d24562fd4 from port ac25283a-c913-45da-bd98-4e9f750d269c Sep 15 04:29:50.610628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1fa49d0a-945a-4db6-b244-5675ea613118 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action" status: 202 len: 0 microversion: 2.1 time: 0.510463 Sep 15 04:29:50.616793 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 474/913] 10.222.0.37 () {60 vars in 1278 bytes} [Wed Sep 15 04:29:50 2021] POST /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 15 04:29:50.636836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-610714d8-3462-4b9c-8552-88947d57bf72 req-9c915431-5205-42d0-b3d9-037a49adb9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:50.638029 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:50.638029 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:29:50.652145 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-610714d8-3462-4b9c-8552-88947d57bf72 req-9c915431-5205-42d0-b3d9-037a49adb9fb service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:50.653663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-610714d8-3462-4b9c-8552-88947d57bf72 req-9c915431-5205-42d0-b3d9-037a49adb9fb service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:50.670464 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-610714d8-3462-4b9c-8552-88947d57bf72 req-9c915431-5205-42d0-b3d9-037a49adb9fb service nova] Creating event network-changed:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:29:50.677804 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-610714d8-3462-4b9c-8552-88947d57bf72 req-9c915431-5205-42d0-b3d9-037a49adb9fb service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045045 Sep 15 04:29:50.681840 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 440/914] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:29:52.038986 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:52.040440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:52.041319 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-ca7e9121-b127-48c4-8d15-8700795b0844 req-8f8e2ab9-b703-409d-9ce7-c436e4533128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:52.042813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:52.042813 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:29:52.048148 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:52.049031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:52.050319 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:52.051018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:52.055269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-ca7e9121-b127-48c4-8d15-8700795b0844 req-8f8e2ab9-b703-409d-9ce7-c436e4533128 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:52.055527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-ca7e9121-b127-48c4-8d15-8700795b0844 req-8f8e2ab9-b703-409d-9ce7-c436e4533128 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:52.075556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-ca7e9121-b127-48c4-8d15-8700795b0844 req-8f8e2ab9-b703-409d-9ce7-c436e4533128 service nova] Creating event network-changed:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:29:52.088605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-ca7e9121-b127-48c4-8d15-8700795b0844 req-8f8e2ab9-b703-409d-9ce7-c436e4533128 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051648 Sep 15 04:29:52.089921 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 441/915] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:29:52.192096 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lazy-loading 'services' on Instance uuid e1c6c192-9095-4d79-a571-9934508010da {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:29:52.295227 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fc594412-f1db-4277-ac10-a21ccfd87b6b tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments/bd3c4d0f-b93a-444e-8204-85ee407266c1" status: 202 len: 0 microversion: 2.1 time: 0.261224 Sep 15 04:29:52.295818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 475/916] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:29:52 2021] DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments/bd3c4d0f-b93a-444e-8204-85ee407266c1 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:29:52.312222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:52.314357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:52.347607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:52.348313 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:52.353673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:52.355051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:52.427290 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-952adf54-d6fa-46ec-ad04-209d183fcddb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125712 Sep 15 04:29:52.436523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 442/917] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:29:52 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:29:53.443232 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:53.444281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:53.450651 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:53.451098 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:53.451879 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:53.452308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:53.480546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6d79fa78-7386-4372-a77d-3d9721febfbb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042106 Sep 15 04:29:53.481084 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 476/918] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:29:53 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:29:53.492224 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:53.493168 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:53.499105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:53.499592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:53.500353 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:53.500787 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:53.580572 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] HTTP exception thrown: Instance e1c6c192-9095-4d79-a571-9934508010da is not attached to volume bd3c4d0f-b93a-444e-8204-85ee407266c1 Sep 15 04:29:53.581078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Returning 404 to user: Instance e1c6c192-9095-4d79-a571-9934508010da is not attached to volume bd3c4d0f-b93a-444e-8204-85ee407266c1 {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:53.581970 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-dcb611bf-cb41-4d52-9516-6b2645431063 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments/bd3c4d0f-b93a-444e-8204-85ee407266c1" status: 404 len: 154 microversion: 2.1 time: 0.095176 Sep 15 04:29:53.582542 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 443/919] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:29:53 2021] DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da/os-volume_attachments/bd3c4d0f-b93a-444e-8204-85ee407266c1 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:29:53.850957 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1448134277", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "79106131-e6ab-4be6-8c55-cfaa19e95b3a"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:53.904817 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] validate_networks() for [('79106131-e6ab-4be6-8c55-cfaa19e95b3a', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:29:54.539684 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:29:54.540250 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:29:54.540583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:29:54.541000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:29:54.541419 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:29:54.551971 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.552430 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:54.553367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.553932 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:54.571688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Getting quotas for project f2e87927a6014a78948b10976d2b9a27. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:29:54.576182 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Getting quotas for user 718c2a5f14bf4d1c8e04a746ad3399d6 and project f2e87927a6014a78948b10976d2b9a27. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:29:54.588142 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:29:54.590785 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:29:54.639240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07bcba6e-f21a-4e71-a03c-f76592c8f9eb tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792151 Sep 15 04:29:54.640063 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 477/920] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:29:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:29:54.649502 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-aa7ce0e9-2227-43c0-b620-42b8e202f5e5 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:54.650343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-aa7ce0e9-2227-43c0-b620-42b8e202f5e5 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:54.707876 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-aa7ce0e9-2227-43c0-b620-42b8e202f5e5 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:54.715159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-aa7ce0e9-2227-43c0-b620-42b8e202f5e5 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1214 microversion: 2.1 time: 0.069322 Sep 15 04:29:54.716047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 444/921] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:54 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:54.729393 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:54.730552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:54.741572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.741946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:54.742797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.743282 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:54.771513 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:29:54.858991 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ed1a801a-d71d-4f9b-be11-de75e0ecb9eb tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 204 len: 0 microversion: 2.1 time: 0.134220 Sep 15 04:29:54.859844 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 478/922] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:29:54 2021] DELETE /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:29:54.868135 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:54.868946 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:54.874694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.875398 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:54.876173 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:54.876608 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:55.006466 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:55.014677 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7b3a6fb2-9252-43b6-8edc-b23ddcb57d3a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1552 microversion: 2.1 time: 0.150692 Sep 15 04:29:55.015259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 445/923] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:54 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:29:55.734605 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:55.735415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:55.741837 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:55.742357 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:55.743269 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:55.743772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:55.815542 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:55.822964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-909c984a-1fbe-4821-b7e4-8c6b05d7a8cc tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1272 microversion: 2.1 time: 0.092672 Sep 15 04:29:55.823575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 479/924] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:55 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:29:56.031390 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:56.032012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:56.038413 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:56.038866 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:56.039667 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:56.040103 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:56.211545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:56.219122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-61ada7fc-6088-4a9c-a2b9-76df9d4bc07a tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1552 microversion: 2.1 time: 0.191401 Sep 15 04:29:56.219718 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 446/925] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:56 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1552 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:56.841611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:56.843162 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:56.850930 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:56.851456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:56.852249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:56.852681 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:57.025040 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-0d5f1d6a-eeeb-4b97-b0e9-194b8e4d9681 req-4730bef3-890c-4686-90d8-d2b6a3c2a192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aac1100-3f15-4d0d-86fc-728b4dbab8fa", "tag": "183afd6b-e77c-4142-93c1-cf221fcba5c9"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:57.028636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:57.028636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:29:57.036577 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0d5f1d6a-eeeb-4b97-b0e9-194b8e4d9681 req-4730bef3-890c-4686-90d8-d2b6a3c2a192 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:57.037768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-0d5f1d6a-eeeb-4b97-b0e9-194b8e4d9681 req-4730bef3-890c-4686-90d8-d2b6a3c2a192 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:57.050734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-0d5f1d6a-eeeb-4b97-b0e9-194b8e4d9681 req-4730bef3-890c-4686-90d8-d2b6a3c2a192 service nova] Creating event network-changed:183afd6b-e77c-4142-93c1-cf221fcba5c9 for instance 1aac1100-3f15-4d0d-86fc-728b4dbab8fa on hv-cinder-76015 Sep 15 04:29:57.055709 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-0d5f1d6a-eeeb-4b97-b0e9-194b8e4d9681 req-4730bef3-890c-4686-90d8-d2b6a3c2a192 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034274 Sep 15 04:29:57.056417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 447/926] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:29:57.086532 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:57.097538 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-47148d76-1c03-4730-9018-445e9f7b4a4a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1314 microversion: 2.1 time: 0.260731 Sep 15 04:29:57.099348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 480/927] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:56 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:57.233530 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-83c30a69-c99a-4fa9-b82a-db7c3ab2a9fd req-f1eb2b12-6850-4462-9677-f7bfadd2d4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c6c192-9095-4d79-a571-9934508010da", "name": "network-vif-deleted", "tag": "ac25283a-c913-45da-bd98-4e9f750d269c"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:29:57.235351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:29:57.235351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:29:57.237156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:57.237897 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:57.243873 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-83c30a69-c99a-4fa9-b82a-db7c3ab2a9fd req-f1eb2b12-6850-4462-9677-f7bfadd2d4be service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:57.244548 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-83c30a69-c99a-4fa9-b82a-db7c3ab2a9fd req-f1eb2b12-6850-4462-9677-f7bfadd2d4be service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:57.244682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:57.245046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:57.245832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:57.246271 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:57.259905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-83c30a69-c99a-4fa9-b82a-db7c3ab2a9fd req-f1eb2b12-6850-4462-9677-f7bfadd2d4be service nova] Creating event network-vif-deleted:ac25283a-c913-45da-bd98-4e9f750d269c for instance e1c6c192-9095-4d79-a571-9934508010da on hv-cinder-76015 Sep 15 04:29:57.264712 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-83c30a69-c99a-4fa9-b82a-db7c3ab2a9fd req-f1eb2b12-6850-4462-9677-f7bfadd2d4be service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035439 Sep 15 04:29:57.265297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 448/928] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:29:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:29:57.354563 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91789bce1a7b424692ef805f21b4d187', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4045049beb4f7b999e66c393eb47a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:57.363796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d80bc7b2-638d-4113-9036-3a7b4a4a1bba tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 200 len: 1510 microversion: 2.1 time: 0.130613 Sep 15 04:29:57.364383 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 481/929] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:57 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 1510 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:29:58.115394 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:58.116054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:58.122034 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:58.122486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:58.123287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:58.123729 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:58.243072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:58.250231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6a949a0f-02ed-41c8-bcb0-8d11a1649cd0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1314 microversion: 2.1 time: 0.138952 Sep 15 04:29:58.250793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 449/930] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:58 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:29:58.382220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:58.382783 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] [instance: e1c6c192-9095-4d79-a571-9934508010da] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:58.388606 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:58.389053 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:58.389818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:58.390236 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:58.403923 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] HTTP exception thrown: Instance e1c6c192-9095-4d79-a571-9934508010da could not be found. Sep 15 04:29:58.404505 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Returning 404 to user: Instance e1c6c192-9095-4d79-a571-9934508010da could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:29:58.405326 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4f19a639-f61a-4c35-a7e9-1b47b5d114e3 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da" status: 404 len: 111 microversion: 2.1 time: 0.027434 Sep 15 04:29:58.405870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 482/931] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:58 2021] GET /compute/v2.1/servers/e1c6c192-9095-4d79-a571-9934508010da => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:29:58.414098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-74159fb5-d6da-4076-8fab-e2049c9b1a53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] Calling method '.version_select at 0x7f02a2de6dc0>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:58.432052 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-74159fb5-d6da-4076-8fab-e2049c9b1a53 tempest-TestMinimumBasicScenario-64824842 tempest-TestMinimumBasicScenario-64824842-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-20565744" status: 202 len: 0 microversion: 2.1 time: 0.021591 Sep 15 04:29:58.432602 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 450/932] 10.222.0.37 () {58 vars in 1266 bytes} [Wed Sep 15 04:29:58 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-20565744 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:29:59.267551 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:29:59.268167 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:29:59.274136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:59.274584 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:59.275387 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:29:59.275823 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:29:59.405446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:29:59.414553 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e6ed4865-4c6c-479e-bf74-04ed760ae369 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1314 microversion: 2.1 time: 0.150523 Sep 15 04:29:59.424415 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 483/933] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:29:59 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:00.431576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:00.432191 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:00.439543 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:00.440129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:00.440909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:00.441344 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:00.576028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:00.588066 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c607df80-1bde-47da-80a5-fe9420c3840a tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1314 microversion: 2.1 time: 0.160066 Sep 15 04:30:00.612278 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 451/934] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:00 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:01.093236 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-4c50f4bf-46f3-4a8a-b30f-bf3ec11b9a7f req-25f61edb-ace5-4f13-a602-9a912c40a54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aac1100-3f15-4d0d-86fc-728b4dbab8fa", "name": "network-vif-plugged", "status": "completed", "tag": "183afd6b-e77c-4142-93c1-cf221fcba5c9"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:01.095395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:01.095395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:01.103508 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-4c50f4bf-46f3-4a8a-b30f-bf3ec11b9a7f req-25f61edb-ace5-4f13-a602-9a912c40a54b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:01.104586 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-4c50f4bf-46f3-4a8a-b30f-bf3ec11b9a7f req-25f61edb-ace5-4f13-a602-9a912c40a54b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:01.118981 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-4c50f4bf-46f3-4a8a-b30f-bf3ec11b9a7f req-25f61edb-ace5-4f13-a602-9a912c40a54b service nova] Creating event network-vif-plugged:183afd6b-e77c-4142-93c1-cf221fcba5c9 for instance 1aac1100-3f15-4d0d-86fc-728b4dbab8fa on hv-cinder-76015 Sep 15 04:30:01.128432 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-4c50f4bf-46f3-4a8a-b30f-bf3ec11b9a7f req-25f61edb-ace5-4f13-a602-9a912c40a54b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Sep 15 04:30:01.130040 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 484/935] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:30:01.605862 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:01.606829 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:01.617553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:01.618279 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:01.619098 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:01.619594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:01.821046 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:01.828674 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f6759d81-967c-4a5f-8cc5-fb7e8de17028 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1314 microversion: 2.1 time: 0.227535 Sep 15 04:30:01.829249 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 452/936] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:01 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:02.846123 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:02.846822 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:02.853264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:02.853814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:02.854600 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:02.855045 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:03.033344 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:03.040716 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ae3bcb40-44b4-4402-a716-9ddd5d05384b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1498 microversion: 2.1 time: 0.198622 Sep 15 04:30:03.041281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 485/937] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:02 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1498 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:03.481351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:03.481970 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:03.488031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:03.488555 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:03.489633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:03.490073 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:03.516788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:30:03.607499 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b5bbbfeb-c415-44b7-a37b-a3281647b75f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "DELETE /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 204 len: 0 microversion: 2.1 time: 0.129253 Sep 15 04:30:03.612066 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 453/938] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:30:03 2021] DELETE /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:30:03.618454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:03.619082 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:03.625679 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:03.626075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:03.626870 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:03.627343 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:03.831377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:03.839354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ea64a6b0-0391-4b1f-9042-889dd16bcb79 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1504 microversion: 2.1 time: 0.225066 Sep 15 04:30:03.839920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 486/939] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:03 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1504 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:04.858071 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:04.858968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:04.865132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:04.865691 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:04.866571 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:04.867137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.162179 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:05.162688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:05.169547 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.170212 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.171280 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.171719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.191123 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:05.200671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ded2740a-406f-469d-8a5f-c713b17c2639 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1504 microversion: 2.1 time: 0.346519 Sep 15 04:30:05.203172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 454/940] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:04 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:05.215712 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-d7f2bc93-82dd-4dff-a5d2-e6a8fa70a698 req-3fa99729-9737-4707-8492-be4b8e1921bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:05.217444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:05.217444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:05.221046 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:30:05.225485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-d7f2bc93-82dd-4dff-a5d2-e6a8fa70a698 req-3fa99729-9737-4707-8492-be4b8e1921bc service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.226179 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-d7f2bc93-82dd-4dff-a5d2-e6a8fa70a698 req-3fa99729-9737-4707-8492-be4b8e1921bc service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.237572 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-d7f2bc93-82dd-4dff-a5d2-e6a8fa70a698 req-3fa99729-9737-4707-8492-be4b8e1921bc service nova] Creating event network-changed:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:30:05.242881 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-d7f2bc93-82dd-4dff-a5d2-e6a8fa70a698 req-3fa99729-9737-4707-8492-be4b8e1921bc service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038196 Sep 15 04:30:05.243705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 455/941] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:05.309987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07bf9a56-8e03-468b-9136-7bd5bc6d5a35 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "DELETE /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 204 len: 0 microversion: 2.1 time: 0.151877 Sep 15 04:30:05.312623 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 487/942] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:30:05 2021] DELETE /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:30:05.323973 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:05.325549 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:05.337895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.338607 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.340072 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.340679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:05.672855 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:05.681959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c9a223f4-de0a-4490-8d9f-11c25778cf42 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1568 microversion: 2.1 time: 0.364259 Sep 15 04:30:05.693890 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 456/943] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:05 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1568 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:05.962717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-3aded9ad-ed80-44de-b7cc-6613b766fd96 req-67d38a54-3284-4e33-a427-0745e6317520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aac1100-3f15-4d0d-86fc-728b4dbab8fa", "name": "network-vif-deleted", "tag": "183afd6b-e77c-4142-93c1-cf221fcba5c9"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:05.966575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:05.966575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:05.988686 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-3aded9ad-ed80-44de-b7cc-6613b766fd96 req-67d38a54-3284-4e33-a427-0745e6317520 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:05.989441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-3aded9ad-ed80-44de-b7cc-6613b766fd96 req-67d38a54-3284-4e33-a427-0745e6317520 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.012902 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-3aded9ad-ed80-44de-b7cc-6613b766fd96 req-67d38a54-3284-4e33-a427-0745e6317520 service nova] Creating event network-vif-deleted:183afd6b-e77c-4142-93c1-cf221fcba5c9 for instance 1aac1100-3f15-4d0d-86fc-728b4dbab8fa on hv-cinder-76015 Sep 15 04:30:06.017779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-3aded9ad-ed80-44de-b7cc-6613b766fd96 req-67d38a54-3284-4e33-a427-0745e6317520 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066933 Sep 15 04:30:06.019004 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 488/944] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:06.222715 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:06.225532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:06.233686 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:06.234415 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.235393 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:06.236533 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.285594 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:06.286516 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.287311 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lazy-loading 'fault' on Instance uuid 1aac1100-3f15-4d0d-86fc-728b4dbab8fa {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:30:06.371488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:06.380865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3b05efa0-3f43-4a71-81b1-23d35716cb75 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 200 len: 1304 microversion: 2.1 time: 0.163600 Sep 15 04:30:06.381435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 457/945] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:06 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 1304 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:06.700848 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:06.701557 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:06.714058 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:06.714825 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.715830 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:06.716707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:06.871587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:06.880408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4f401501-1e97-47db-aa4d-7b62eda8988a tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1449 microversion: 2.1 time: 0.183440 Sep 15 04:30:06.881113 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 489/946] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:06 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1449 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:07.228641 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:07.229544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:07.235676 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.236418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.236905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.237337 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.270130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0aecbeb7-bbb3-4e12-816f-5034ec75f41c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044797 Sep 15 04:30:07.270703 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 458/947] 10.222.0.37 () {60 vars in 1343 bytes} [Wed Sep 15 04:30:07 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:07.338107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:07.338595 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:07.353876 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.354361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.355345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.355953 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.388937 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:30:07.398519 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:07.399356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 1aac1100-3f15-4d0d-86fc-728b4dbab8fa] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:07.417696 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.418374 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.419357 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.419937 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.439872 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] HTTP exception thrown: Instance 1aac1100-3f15-4d0d-86fc-728b4dbab8fa could not be found. Sep 15 04:30:07.440860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Returning 404 to user: Instance 1aac1100-3f15-4d0d-86fc-728b4dbab8fa could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:07.442891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-92ddc96f-9d05-407f-a620-ed34241fd079 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa" status: 404 len: 111 microversion: 2.1 time: 0.048910 Sep 15 04:30:07.444351 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 459/948] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:07 2021] GET /compute/v2.1/servers/1aac1100-3f15-4d0d-86fc-728b4dbab8fa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:30:07.509717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-401551a7-a2c1-4d98-baef-1fffa4a101dd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 204 len: 0 microversion: 2.20 time: 0.175008 Sep 15 04:30:07.514338 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 490/949] 10.222.0.37 () {60 vars in 1280 bytes} [Wed Sep 15 04:30:07 2021] DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 04:30:07.530467 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:07.531426 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:07.542128 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.542578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.546558 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.547240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.597646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-844819415", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "79106131-e6ab-4be6-8c55-cfaa19e95b3a"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:07.691024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] validate_networks() for [('79106131-e6ab-4be6-8c55-cfaa19e95b3a', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:30:07.907430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:07.920160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:07.921648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:07.926591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9aaea00e-f8d9-4ce9-89a4-14a7e55642fd tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.409251 Sep 15 04:30:07.938972 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 460/950] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:07 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:07.945807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-94190277-ac22-492e-87b5-ccc1ebca5078 req-a70bfb72-7def-4bc5-870f-4398650e3cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e460d0-b6ba-4ca2-9cce-41a41748d73d", "name": "network-vif-deleted", "tag": "32ef0aad-5444-4577-9f96-8182e63325c7"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:07.947642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:07.947642 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:07.957980 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-94190277-ac22-492e-87b5-ccc1ebca5078 req-a70bfb72-7def-4bc5-870f-4398650e3cd8 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:07.958444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-94190277-ac22-492e-87b5-ccc1ebca5078 req-a70bfb72-7def-4bc5-870f-4398650e3cd8 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:07.981663 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-94190277-ac22-492e-87b5-ccc1ebca5078 req-a70bfb72-7def-4bc5-870f-4398650e3cd8 service nova] Creating event network-vif-deleted:32ef0aad-5444-4577-9f96-8182e63325c7 for instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d on hv-cinder-76015 Sep 15 04:30:07.994211 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-94190277-ac22-492e-87b5-ccc1ebca5078 req-a70bfb72-7def-4bc5-870f-4398650e3cd8 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053324 Sep 15 04:30:07.999518 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 461/951] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:08.008702 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:08.009752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:08.021441 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.022138 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:08.023265 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.024149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:08.136076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:08.154573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d6e4f470-47de-41a7-bea8-b07ff420e7ca tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1218 microversion: 2.1 time: 0.152658 Sep 15 04:30:08.167673 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 462/952] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:07 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1218 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:08.269018 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:30:08.269633 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:30:08.270248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:30:08.270882 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:30:08.271345 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:30:08.281109 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.281558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:08.282377 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.282817 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:08.300316 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Getting quotas for project f2e87927a6014a78948b10976d2b9a27. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:30:08.305852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Getting quotas for user 718c2a5f14bf4d1c8e04a746ad3399d6 and project f2e87927a6014a78948b10976d2b9a27. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:30:08.319111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:30:08.321731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:30:08.369262 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-954e5254-31bc-42eb-8c4f-b440db28ae71 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780829 Sep 15 04:30:08.369884 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 491/953] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:30:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:30:08.380670 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1e937d91-70bc-4ab9-b411-61907280e202 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:08.382388 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1e937d91-70bc-4ab9-b411-61907280e202 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:08.437575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1e937d91-70bc-4ab9-b411-61907280e202 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:08.444748 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1e937d91-70bc-4ab9-b411-61907280e202 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1213 microversion: 2.1 time: 0.068863 Sep 15 04:30:08.445308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 463/954] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:08 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:08.945165 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:08.945707 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:08.951614 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.952063 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:08.952824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:08.953259 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.072895 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:09.080518 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:09.082520 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:09.083691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a12e09cd-e30b-433a-9ccd-46b6edbeada9 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.142924 Sep 15 04:30:09.084258 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 492/955] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:08 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:09.171987 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:09.172634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:09.178829 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:09.179328 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.180091 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:09.180527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.210562 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:09.211012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.211485 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lazy-loading 'fault' on Instance uuid 05e460d0-b6ba-4ca2-9cce-41a41748d73d {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:30:09.249710 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:09.257782 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-efe3f105-7969-48ae-9aab-34e17053aa99 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1223 microversion: 2.1 time: 0.089473 Sep 15 04:30:09.258336 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 464/956] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:09 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:09.461717 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:09.462266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:09.468130 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:09.468580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.469337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:09.469769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:09.531068 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:09.539491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f6e3da2e-1524-461c-bd5e-f08657129a40 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1217 microversion: 2.1 time: 0.081434 Sep 15 04:30:09.540057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 493/957] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:09 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:10.101781 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:10.102386 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:10.108132 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.108578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.109348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.109790 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.235263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:10.243534 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:10.245025 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:10.246176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a3c5f0ca-a295-4187-b01b-8ec6383a1aa8 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.148659 Sep 15 04:30:10.246738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 465/958] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:10 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:10.274353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:10.274955 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:10.280706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.281152 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.281911 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.282347 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.312015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.312460 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.313171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lazy-loading 'fault' on Instance uuid 05e460d0-b6ba-4ca2-9cce-41a41748d73d {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:30:10.352818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a1c379e77c94773aaad49730f569a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dd0993d5a014825880ad0da74b21331', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:10.360076 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-97226f7e-4d6e-4b9d-aded-de16cb53dcf7 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 200 len: 1223 microversion: 2.1 time: 0.089539 Sep 15 04:30:10.360638 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 494/959] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:10 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:10.556857 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:10.557472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:10.563799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.564251 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.565022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:10.565461 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:10.623920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:10.631858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-373886f1-fa42-4ad3-b746-90e0ce74eec3 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1217 microversion: 2.1 time: 0.078716 Sep 15 04:30:10.632428 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 466/960] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:10 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:11.264448 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:11.265058 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:11.271611 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.272056 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.272814 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.273246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.377517 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:11.378122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] [instance: 05e460d0-b6ba-4ca2-9cce-41a41748d73d] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:11.385928 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.386836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.387708 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.388225 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.414151 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:11.415605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] HTTP exception thrown: Instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d could not be found. Sep 15 04:30:11.416801 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Returning 404 to user: Instance 05e460d0-b6ba-4ca2-9cce-41a41748d73d could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:11.417893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2c3b4b4e-0554-4853-a866-3c37c300482c tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d" status: 404 len: 111 microversion: 2.1 time: 0.044026 Sep 15 04:30:11.418672 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 467/961] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:11 2021] GET /compute/v2.1/servers/05e460d0-b6ba-4ca2-9cce-41a41748d73d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:30:11.423260 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:11.425219 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:11.426880 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-040715b4-e543-416c-be8b-c86298cdfb75 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.166235 Sep 15 04:30:11.441972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 495/962] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:11 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:11.650269 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:11.650880 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:11.660445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.661486 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.662803 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:11.663563 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:11.742066 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:11.758009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-55e4255f-ec51-4ab3-a54b-7beea4281822 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1271 microversion: 2.1 time: 0.111804 Sep 15 04:30:11.768831 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 468/963] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:11 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:11.780884 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ef6e77eb-b137-415b-b2ed-a650247e35c1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] Calling method '.version_select at 0x7f02a20b74c0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:11.803943 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ef6e77eb-b137-415b-b2ed-a650247e35c1 tempest-TestShelveInstance-1329880106 tempest-TestShelveInstance-1329880106-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-426019657" status: 202 len: 0 microversion: 2.1 time: 0.028238 Sep 15 04:30:11.805947 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 496/964] 10.222.0.37 () {58 vars in 1251 bytes} [Wed Sep 15 04:30:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-426019657 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:30:12.446532 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:12.447914 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:12.454234 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:12.459891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:12.460831 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:12.461430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:12.777301 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:12.778592 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:12.788613 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:12.789211 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:12.790779 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:12.793654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:13.174222 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:13.206187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:13.211746 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:13.214638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-57b5f92d-9964-423c-a33e-729152151f42 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1723 microversion: 2.20 time: 0.771117 Sep 15 04:30:13.217739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 469/965] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:12 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1723 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:13.281278 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:13.295292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-6061c0bd-46f8-417f-a61c-0cba7ce6245b tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.522585 Sep 15 04:30:13.296072 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 497/966] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:12 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:13.399231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-54b1e662-da59-40c7-9837-ce81f3240043 req-04830a25-8529-4e06-b02b-ab10ea90a57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "260367a5-4aa7-48c1-bc82-aea049446710", "tag": "a5e31d0c-7ead-49ce-babf-70f2bdd2c369"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:13.402047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:13.402047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:13.423361 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-54b1e662-da59-40c7-9837-ce81f3240043 req-04830a25-8529-4e06-b02b-ab10ea90a57b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:13.424508 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-54b1e662-da59-40c7-9837-ce81f3240043 req-04830a25-8529-4e06-b02b-ab10ea90a57b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:13.447819 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-54b1e662-da59-40c7-9837-ce81f3240043 req-04830a25-8529-4e06-b02b-ab10ea90a57b service nova] Creating event network-changed:a5e31d0c-7ead-49ce-babf-70f2bdd2c369 for instance 260367a5-4aa7-48c1-bc82-aea049446710 on hv-cinder-76015 Sep 15 04:30:13.454665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-54b1e662-da59-40c7-9837-ce81f3240043 req-04830a25-8529-4e06-b02b-ab10ea90a57b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063120 Sep 15 04:30:13.455931 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 470/967] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:13.640533 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-1f8ba849-679b-4d85-b691-26acf00fff84 req-e943fbce-f975-42b2-80af-373e12c3ec53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beeb1b79-9490-4cb0-bea1-10bc320f53be", "name": "network-vif-deleted", "tag": "1b3dc2f5-e12b-4428-b9d9-c83ffbae9552"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:13.646471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:13.646471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:13.662901 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-1f8ba849-679b-4d85-b691-26acf00fff84 req-e943fbce-f975-42b2-80af-373e12c3ec53 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:13.663449 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-1f8ba849-679b-4d85-b691-26acf00fff84 req-e943fbce-f975-42b2-80af-373e12c3ec53 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:13.676163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-1f8ba849-679b-4d85-b691-26acf00fff84 req-e943fbce-f975-42b2-80af-373e12c3ec53 service nova] Creating event network-vif-deleted:1b3dc2f5-e12b-4428-b9d9-c83ffbae9552 for instance beeb1b79-9490-4cb0-bea1-10bc320f53be on hv-cinder-76015 Sep 15 04:30:13.681546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-1f8ba849-679b-4d85-b691-26acf00fff84 req-e943fbce-f975-42b2-80af-373e12c3ec53 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044772 Sep 15 04:30:13.682688 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 498/968] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:14.236869 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:14.238148 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:14.250617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:14.251870 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:14.259698 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:14.260523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:14.314215 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:14.315351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:14.320912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:14.321784 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:14.322997 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lazy-loading 'fault' on Instance uuid beeb1b79-9490-4cb0-bea1-10bc320f53be {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:30:14.327631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:14.328300 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:14.330257 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:14.334609 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:14.497648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:14.510917 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:14.515862 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e764d4c1d57740c1808fd9c877f46008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a581abeebb41f3b727ee96e0441f04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:14.517085 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-810a3342-065b-4312-8e21-36dbc866d65e tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 200 len: 1372 microversion: 2.20 time: 0.285103 Sep 15 04:30:14.520127 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 471/969] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:14 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 1372 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 15 04:30:14.670810 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:14.681612 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3dfffb55-bdd1-4245-8f1e-15370b3fae88 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.372519 Sep 15 04:30:14.682458 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 499/970] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:14 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:14.761445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1380878911", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-460250898", "security_groups": [{"name": "tempest-secgroup-smoke-1810072556"}], "block_device_mapping_v2": [{"uuid": "f5aa8375-20f8-4959-b2f0-1f0952ff357a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:14.897067 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] validate_networks() for [('cf6251ee-ab6e-4c9e-9d3a-89dc018ba84c', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:30:15.356859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:30:15.358646 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:30:15.359490 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:30:15.360031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:30:15.361860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:30:15.374158 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.374723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.375645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.376172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.404134 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:30:15.408248 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Getting quotas for user fc599faf327249919f8dc76e65061ae3 and project 45c1fb8c3a214f5ba4aacbcfbe2af2e6. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:30:15.481926 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:30:15.484473 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5aa8375-20f8-4959-b2f0-1f0952ff357a',volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:30:15.537264 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:15.538653 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:15.545185 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.545739 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.546859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.547670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.563919 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. Sep 15 04:30:15.564864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:15.566137 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-156f7e93-907e-4e99-960a-5e70177e002c tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 404 len: 111 microversion: 2.20 time: 0.032903 Sep 15 04:30:15.570406 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 500/971] 10.222.0.37 () {60 vars in 1277 bytes} [Wed Sep 15 04:30:15 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 15 04:30:15.575019 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cc3ae6eb-bfcc-4d82-9784-dc2694649896 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '.version_select at 0x7f02a20d7dc0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:15.604434 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cc3ae6eb-bfcc-4d82-9784-dc2694649896 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006210006" status: 204 len: 0 microversion: 2.20 time: 0.032768 Sep 15 04:30:15.605274 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 501/972] 10.222.0.37 () {60 vars in 1262 bytes} [Wed Sep 15 04:30:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2006210006 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 15 04:30:15.657989 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-039fff4a-c166-4715-b83b-dc8ff85ddd65 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.900278 Sep 15 04:30:15.659579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 472/973] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:30:14 2021] POST /compute/v2.1/servers => generated 406 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 15 04:30:15.670342 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cd7eec67-a6aa-4137-b6be-6ce03985bf68 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:15.671838 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cd7eec67-a6aa-4137-b6be-6ce03985bf68 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:15.713492 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:15.715752 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:15.723005 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.723551 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.724333 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:15.724765 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:15.778718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cd7eec67-a6aa-4137-b6be-6ce03985bf68 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:15.787864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cd7eec67-a6aa-4137-b6be-6ce03985bf68 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1094 microversion: 2.1 time: 0.121725 Sep 15 04:30:15.788657 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 502/974] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:15 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1094 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:15.883948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:15.892137 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8d639678-515b-4a8e-8be1-af4c4a4294d0 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.196338 Sep 15 04:30:15.892789 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 473/975] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:15 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:16.805074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:16.805684 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:16.815832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:16.823317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:16.824440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:16.826790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:16.919484 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:16.920545 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:16.933420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:16.943459 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:16.944359 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:16.944895 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:17.026182 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:17.038348 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d7c9d1e3-8f43-4b13-a622-37b88fc5c282 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1210 microversion: 2.1 time: 0.237431 Sep 15 04:30:17.040964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 503/976] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:16 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1210 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:17.252154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:17.266164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-2c9b74a2-1452-4164-8637-d030aae2799e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.358894 Sep 15 04:30:17.266164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 474/977] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:16 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:17.914956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:17.915596 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:17.921625 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:17.922323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:17.923523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:17.923967 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:17.940035 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. Sep 15 04:30:17.940633 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:17.941550 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-56d26005-de03-40d7-9eda-31308640be50 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 404 len: 111 microversion: 2.1 time: 0.030687 Sep 15 04:30:17.942097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 504/978] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:30:17 2021] DELETE /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:30:17.950408 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:17.951948 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: beeb1b79-9490-4cb0-bea1-10bc320f53be] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:17.959444 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:17.959975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:17.960898 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:17.961436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:17.976385 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. Sep 15 04:30:17.977163 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance beeb1b79-9490-4cb0-bea1-10bc320f53be could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:17.978073 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-107815af-ea61-4522-84e1-2f548fa00c30 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be" status: 404 len: 111 microversion: 2.1 time: 0.031615 Sep 15 04:30:17.978705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 475/979] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:17 2021] GET /compute/v2.1/servers/beeb1b79-9490-4cb0-bea1-10bc320f53be => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:30:18.058334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:18.059317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:18.066973 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:18.067770 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:18.069128 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:18.069902 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:18.210842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:18.218479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-53c3de26-a66b-40d2-adee-32bee93b630a tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.165343 Sep 15 04:30:18.219214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 505/980] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:18 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:18.281720 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:18.282430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:18.288150 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:18.288626 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:18.289636 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:18.290118 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:18.419092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:18.426999 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-58ae3412-e153-4374-bc0e-8b27a5bf401f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.148926 Sep 15 04:30:18.427622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 476/981] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:18 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:19.129074 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:19.130147 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:19.137095 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.137740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.138727 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.139186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.154197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. Sep 15 04:30:19.155183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:19.156323 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8ff969c9-95ce-4156-991a-0fe5ca2f4701 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 404 len: 111 microversion: 2.1 time: 0.031530 Sep 15 04:30:19.157365 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 506/982] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:30:19 2021] DELETE /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:30:19.166554 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:19.167238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] [instance: 9af1a4f0-8870-46fa-8b33-7b855766dda3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:19.184041 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-734f86d1-6e58-447b-9f62-725c9be21b0c req-66b59f99-6518-4f7b-ac03-4f02aded66e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb", "tag": "67ae3844-b7f5-4228-af9f-4ec1589504d6"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:19.185620 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:19.185620 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:19.186255 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.187755 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.188905 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.189298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.209328 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-734f86d1-6e58-447b-9f62-725c9be21b0c req-66b59f99-6518-4f7b-ac03-4f02aded66e2 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.209786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-734f86d1-6e58-447b-9f62-725c9be21b0c req-66b59f99-6518-4f7b-ac03-4f02aded66e2 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.217749 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] HTTP exception thrown: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. Sep 15 04:30:19.218615 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] Returning 404 to user: Instance 9af1a4f0-8870-46fa-8b33-7b855766dda3 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:19.219800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-dafaf670-89a0-4de4-9f2d-31d4ab985c08 tempest-AttachVolumeShelveTestJSON-1780567691 tempest-AttachVolumeShelveTestJSON-1780567691-project] 10.222.0.37 "GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3" status: 404 len: 111 microversion: 2.1 time: 0.058104 Sep 15 04:30:19.222429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 477/983] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:19 2021] GET /compute/v2.1/servers/9af1a4f0-8870-46fa-8b33-7b855766dda3 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:30:19.236167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:19.236794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:19.238183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-734f86d1-6e58-447b-9f62-725c9be21b0c req-66b59f99-6518-4f7b-ac03-4f02aded66e2 service nova] Creating event network-changed:67ae3844-b7f5-4228-af9f-4ec1589504d6 for instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb on hv-cinder-76015 Sep 15 04:30:19.243888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-734f86d1-6e58-447b-9f62-725c9be21b0c req-66b59f99-6518-4f7b-ac03-4f02aded66e2 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063316 Sep 15 04:30:19.245032 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 507/984] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:19.246154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.246612 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.250964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-ae57c8ad-4c23-4c0a-b995-bbfd76d04295 req-b5a31bad-fdfb-4bcd-b2d1-d628c25b662e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260367a5-4aa7-48c1-bc82-aea049446710", "name": "network-vif-plugged", "status": "completed", "tag": "a5e31d0c-7ead-49ce-babf-70f2bdd2c369"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:19.251753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.252219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.252526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:19.252526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:19.260407 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ae57c8ad-4c23-4c0a-b995-bbfd76d04295 req-b5a31bad-fdfb-4bcd-b2d1-d628c25b662e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.261295 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ae57c8ad-4c23-4c0a-b995-bbfd76d04295 req-b5a31bad-fdfb-4bcd-b2d1-d628c25b662e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.274466 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-ae57c8ad-4c23-4c0a-b995-bbfd76d04295 req-b5a31bad-fdfb-4bcd-b2d1-d628c25b662e service nova] Creating event network-vif-plugged:a5e31d0c-7ead-49ce-babf-70f2bdd2c369 for instance 260367a5-4aa7-48c1-bc82-aea049446710 on hv-cinder-76015 Sep 15 04:30:19.279781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-ae57c8ad-4c23-4c0a-b995-bbfd76d04295 req-b5a31bad-fdfb-4bcd-b2d1-d628c25b662e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033300 Sep 15 04:30:19.280969 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 508/985] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:19.446208 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:19.447241 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:19.460685 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.461613 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.462659 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:19.463364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:19.893977 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:19.902442 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-40220b7d-a33a-48a5-893b-3161e9a24595 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.670156 Sep 15 04:30:19.903526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 478/986] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:19 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:20.072913 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:20.081099 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b9e43547-fd94-4603-81c9-21b1f609e609 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.641034 Sep 15 04:30:20.081842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 509/987] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:19 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:20.921007 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:20.921648 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:20.928129 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:20.928584 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:20.929354 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:20.929962 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:21.099192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:21.099845 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:21.105666 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:21.106118 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:21.106909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:21.107391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:21.242586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:21.250251 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1b51a66d-070f-4862-bfb5-cf430e10137b tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.332991 Sep 15 04:30:21.250979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 479/988] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:20 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:21.493725 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:21.501713 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-fb6074a8-0803-47d1-ac75-86b62741cbd2 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1313 microversion: 2.1 time: 0.406943 Sep 15 04:30:21.502516 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 510/989] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:21 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1313 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:22.270028 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:22.271315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:22.287682 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:22.288417 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:22.289540 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:22.295890 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:22.520158 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:22.521395 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:22.528925 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:22.532555 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:22.535523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:22.538290 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:22.917213 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:22.922450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:22.927235 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-298c52e5-ecb2-4021-92fc-09dcf6cb7b98 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.663206 Sep 15 04:30:22.936863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07d6b906-3c42-4b95-bc36-79c74943d27f tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1496 microversion: 2.1 time: 0.417481 Sep 15 04:30:22.936863 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 511/990] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:22 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1496 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:22.938370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 480/991] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:22 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:23.442416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:23.443650 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:23.449829 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.450504 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:23.451809 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.452422 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:23.483493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:30:23.587277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-876405a1-1e5c-449b-bc8d-118ff2946f05 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "DELETE /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 204 len: 0 microversion: 2.1 time: 0.149547 Sep 15 04:30:23.588192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 512/992] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:30:23 2021] DELETE /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:30:23.596819 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:23.598032 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:23.607265 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.608330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:23.609684 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.610551 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:23.892605 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:23.904657 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-02fce2fe-ef9f-4e8d-8e1f-173f30ed9e12 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1502 microversion: 2.1 time: 0.311807 Sep 15 04:30:23.905933 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 481/993] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:23 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1502 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:23.946308 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:23.947022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:23.959554 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.961861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:23.967408 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:23.968156 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:24.153932 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:24.164482 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-922ef7f0-98b6-4a99-8978-688fd91973ee tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.221941 Sep 15 04:30:24.165372 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 513/994] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:23 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:24.928152 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:24.928763 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:24.934549 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:24.935014 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:24.935861 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:24.936296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:25.072983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '718c2a5f14bf4d1c8e04a746ad3399d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e87927a6014a78948b10976d2b9a27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:25.081044 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1f6339d0-3b41-49c1-b702-c4dc95065d35 tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 200 len: 1502 microversion: 2.1 time: 0.160478 Sep 15 04:30:25.081709 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 482/995] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:24 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:25.181145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:25.181764 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:25.188361 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:25.188812 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:25.189786 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:25.190231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:25.372327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:25.372456 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-c9b08277-384f-4f40-978d-de7acd4368a9 req-e118a7c2-2327-4a0d-8256-7002be7702ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "260367a5-4aa7-48c1-bc82-aea049446710", "name": "network-vif-deleted", "tag": "a5e31d0c-7ead-49ce-babf-70f2bdd2c369"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:25.373939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:25.373939 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:25.382259 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c9b08277-384f-4f40-978d-de7acd4368a9 req-e118a7c2-2327-4a0d-8256-7002be7702ef service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:25.382704 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c9b08277-384f-4f40-978d-de7acd4368a9 req-e118a7c2-2327-4a0d-8256-7002be7702ef service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:25.386749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9ffea8b1-61e7-4774-b6f2-fc04d8a501bb tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.209252 Sep 15 04:30:25.387824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 514/996] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:25 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:25.397611 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-c9b08277-384f-4f40-978d-de7acd4368a9 req-e118a7c2-2327-4a0d-8256-7002be7702ef service nova] Creating event network-vif-deleted:a5e31d0c-7ead-49ce-babf-70f2bdd2c369 for instance 260367a5-4aa7-48c1-bc82-aea049446710 on hv-cinder-76015 Sep 15 04:30:25.402553 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-c9b08277-384f-4f40-978d-de7acd4368a9 req-e118a7c2-2327-4a0d-8256-7002be7702ef service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033657 Sep 15 04:30:25.406566 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 483/997] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:30:26.099075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:26.099864 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] [instance: 260367a5-4aa7-48c1-bc82-aea049446710] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:26.107936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:26.108416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:26.109314 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:26.109772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:26.123467 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] HTTP exception thrown: Instance 260367a5-4aa7-48c1-bc82-aea049446710 could not be found. Sep 15 04:30:26.124285 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] Returning 404 to user: Instance 260367a5-4aa7-48c1-bc82-aea049446710 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:30:26.125125 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7b94f12b-0291-48c8-9ec2-db2a6288157e tempest-VolumesActionsTest-65416193 tempest-VolumesActionsTest-65416193-project] 10.222.0.37 "GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710" status: 404 len: 111 microversion: 2.1 time: 0.031265 Sep 15 04:30:26.125663 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 515/998] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:26 2021] GET /compute/v2.1/servers/260367a5-4aa7-48c1-bc82-aea049446710 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:30:26.417302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:26.417302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:26.417302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:26.417302 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:26.417965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:26.417965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:26.604911 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:26.613172 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-adc0dd38-d3d3-41a5-bff3-c24281da06ce tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.212193 Sep 15 04:30:26.614130 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 484/999] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:26 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:27.087283 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2017365139", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "64c23034-54e2-4845-8c25-1dac43a92296"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:27.140501 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] validate_networks() for [('64c23034-54e2-4845-8c25-1dac43a92296', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:30:27.496052 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:30:27.496485 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:30:27.496964 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:30:27.497409 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:30:27.497873 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:30:27.508233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:27.508824 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:27.511243 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:27.511694 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:27.528631 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:30:27.532500 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for user eae6fea0ede0479490cf297d39126b27 and project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:30:27.543545 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:30:27.545855 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:30:27.592653 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-9f75bcbf-1f76-49c3-ab6b-fbaccb3d4293 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625543 Sep 15 04:30:27.593305 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 516/1000] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:30:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:30:27.603335 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-20e79bcd-62e8-4ead-bbae-f442c03b0b63 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:27.604865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-20e79bcd-62e8-4ead-bbae-f442c03b0b63 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:27.630531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:27.631493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:27.642710 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:27.643287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:27.644479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:27.644920 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:27.677974 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-20e79bcd-62e8-4ead-bbae-f442c03b0b63 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:27.686564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-20e79bcd-62e8-4ead-bbae-f442c03b0b63 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1218 microversion: 2.1 time: 0.087050 Sep 15 04:30:27.687429 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 485/1001] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:27 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:27.793527 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:27.801222 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e9a6aadf-0dde-4e49-9c23-02719afaeda8 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.175237 Sep 15 04:30:27.801797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 517/1002] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:27 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:28.703825 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:28.704469 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:28.711303 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:28.711751 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:28.712518 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:28.712943 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:28.777108 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:28.785349 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bd5878cb-7f52-40ac-82df-33966a00af53 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1222 microversion: 2.1 time: 0.085218 Sep 15 04:30:28.785916 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 486/1003] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:28 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:28.817859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:28.818477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:28.824531 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:28.825107 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:28.825923 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:28.826374 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:28.953078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:28.962276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-acc05181-3e1c-4f62-8080-c17ee08147e1 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.147970 Sep 15 04:30:28.962910 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 518/1004] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:28 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:29.803027 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:29.803881 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:29.810755 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:29.811262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:29.812054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:29.812495 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:29.875370 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:29.885252 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-133407ef-2bc7-42c7-a518-006650c95943 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1214 microversion: 2.1 time: 0.087140 Sep 15 04:30:29.885830 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 487/1005] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:29 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:29.981067 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:29.981691 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:29.988580 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:29.989037 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:29.990993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:29.990993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:30.134435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:30.141954 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f695b932-f152-470b-9f60-c76ae2c39dd4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.164557 Sep 15 04:30:30.142523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 519/1006] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:29 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:30.904669 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:30.905320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:30.912186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:30.912638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:30.913645 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:30.914087 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:30.991916 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:31.021960 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-746b771f-535d-4868-bf2f-9ffbeb266a7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1276 microversion: 2.1 time: 0.122340 Sep 15 04:30:31.023320 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 488/1007] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:30 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1276 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:31.159615 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:31.159615 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:31.183022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:31.183022 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:31.183910 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:31.184354 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:31.348797 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:31.367581 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d4708123-907e-44bb-9bee-d8d3711503c0 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.211195 Sep 15 04:30:31.373126 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 520/1008] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:31 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:32.082185 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-73bb0af3-c5ef-49d2-b745-01d5072a2358 req-23ff9e80-ad13-4f24-b405-443b34960e20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb0f710-ce83-4f45-8509-d66fc6a2d628", "tag": "c862dfa3-6aa6-4cab-93b9-32edb81d2255"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:32.085097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:32.085097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:32.088630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:32.093454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:32.122991 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.126463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-73bb0af3-c5ef-49d2-b745-01d5072a2358 req-23ff9e80-ad13-4f24-b405-443b34960e20 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.130401 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.131294 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-73bb0af3-c5ef-49d2-b745-01d5072a2358 req-23ff9e80-ad13-4f24-b405-443b34960e20 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.131439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.134833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.177163 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-73bb0af3-c5ef-49d2-b745-01d5072a2358 req-23ff9e80-ad13-4f24-b405-443b34960e20 service nova] Creating event network-changed:c862dfa3-6aa6-4cab-93b9-32edb81d2255 for instance eeb0f710-ce83-4f45-8509-d66fc6a2d628 on hv-cinder-76015 Sep 15 04:30:32.193178 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-73bb0af3-c5ef-49d2-b745-01d5072a2358 req-23ff9e80-ad13-4f24-b405-443b34960e20 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122371 Sep 15 04:30:32.194130 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 521/1009] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:32.311579 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-4f935c17-114c-4235-8989-c03f53b035d2 req-9989b0db-bb3a-4b77-b6ac-d0f412ceec66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb", "name": "network-vif-plugged", "status": "completed", "tag": "67ae3844-b7f5-4228-af9f-4ec1589504d6"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:32.314494 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:32.314494 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:32.329672 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-4f935c17-114c-4235-8989-c03f53b035d2 req-9989b0db-bb3a-4b77-b6ac-d0f412ceec66 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.332899 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-4f935c17-114c-4235-8989-c03f53b035d2 req-9989b0db-bb3a-4b77-b6ac-d0f412ceec66 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.366416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-4f935c17-114c-4235-8989-c03f53b035d2 req-9989b0db-bb3a-4b77-b6ac-d0f412ceec66 service nova] Creating event network-vif-plugged:67ae3844-b7f5-4228-af9f-4ec1589504d6 for instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb on hv-cinder-76015 Sep 15 04:30:32.373634 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-4f935c17-114c-4235-8989-c03f53b035d2 req-9989b0db-bb3a-4b77-b6ac-d0f412ceec66 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070799 Sep 15 04:30:32.374585 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 522/1010] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:32.394983 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:32.396233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:32.404468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.405109 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.406047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:32.406592 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:32.443867 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:32.455749 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-61c75ee5-e68e-4554-83b0-52e0d2e1695c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.417509 Sep 15 04:30:32.456897 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 489/1011] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:32 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:32.623559 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:32.632322 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bf7db9a8-7af5-4072-86ea-0bbfc8a741b4 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.246448 Sep 15 04:30:32.632903 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 523/1012] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:32 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:33.472807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:33.473513 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:33.491364 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:33.492114 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:33.493581 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:33.494358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:33.650948 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:33.652221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:33.658987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:33.664646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:33.667907 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:33.673842 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:33.710038 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:33.740057 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d78eaa1f-0140-4e97-9ec2-088bf5e82f5f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.265331 Sep 15 04:30:33.741261 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 490/1013] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:33 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:33.877706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:33.889356 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-76139b21-df60-49ad-8457-45a2fb3e5703 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1266 microversion: 2.1 time: 0.241487 Sep 15 04:30:33.889952 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 524/1014] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:33 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:34.758101 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:34.758697 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:34.765807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:34.766383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:34.767246 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:34.767694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:34.910695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:34.911632 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:34.919288 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:34.921042 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:34.921769 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:34.922880 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:34.923479 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:34.927575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-cd77e219-f235-4d44-94f1-57b21ae2118d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.173649 Sep 15 04:30:34.928330 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 491/1015] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:34 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:35.083472 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:35.094736 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e2d043bb-7a40-46ef-a946-88c4d2f34bca tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1454 microversion: 2.1 time: 0.189095 Sep 15 04:30:35.096235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 525/1016] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:34 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:35.124995 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:35.131634 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:35.139488 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:35.140180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:35.141153 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:35.141757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:35.317231 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:35.325576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-3a212779-05b4-46d4-97b9-96946c46d494 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1454 microversion: 2.1 time: 0.214046 Sep 15 04:30:35.326596 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 492/1017] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:35 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1454 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:35.947670 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:35.948292 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:35.974134 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:35.974992 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:35.979519 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:35.982221 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:36.196325 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:36.205719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-f8d94ea4-2835-4310-9d94-5ba488450afa tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.263994 Sep 15 04:30:36.206574 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 526/1018] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:35 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:37.221632 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:37.222981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:37.231716 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:37.234113 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:37.235297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:37.238182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:37.412211 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:37.421113 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d9548ec7-f05b-47f3-8eaa-cfdd1ea130f9 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.203016 Sep 15 04:30:37.430788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 493/1019] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:37 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:37.896367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-9708c8f2-3dcd-4bb2-9764-be1494dc8bef req-a8daad28-756c-4980-a295-d8753f79816c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb", "tag": "67ae3844-b7f5-4228-af9f-4ec1589504d6"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:37.897945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:37.897945 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:37.905028 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9708c8f2-3dcd-4bb2-9764-be1494dc8bef req-a8daad28-756c-4980-a295-d8753f79816c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:37.905731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-9708c8f2-3dcd-4bb2-9764-be1494dc8bef req-a8daad28-756c-4980-a295-d8753f79816c service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:37.924386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-9708c8f2-3dcd-4bb2-9764-be1494dc8bef req-a8daad28-756c-4980-a295-d8753f79816c service nova] Creating event network-changed:67ae3844-b7f5-4228-af9f-4ec1589504d6 for instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb on hv-cinder-76015 Sep 15 04:30:37.930324 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-9708c8f2-3dcd-4bb2-9764-be1494dc8bef req-a8daad28-756c-4980-a295-d8753f79816c service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038876 Sep 15 04:30:37.931599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 527/1020] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:30:38.438383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:38.439757 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:38.448221 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:38.448931 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:38.450011 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:38.450600 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:38.532113 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-ada94e4a-d4ed-4120-a672-08f885045c3e req-74b7fca9-0470-46a4-9d31-32dd67d8b6d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0f710-ce83-4f45-8509-d66fc6a2d628", "name": "network-vif-plugged", "status": "completed", "tag": "c862dfa3-6aa6-4cab-93b9-32edb81d2255"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:38.535235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:38.535235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:30:38.559582 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ada94e4a-d4ed-4120-a672-08f885045c3e req-74b7fca9-0470-46a4-9d31-32dd67d8b6d5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:38.560309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-ada94e4a-d4ed-4120-a672-08f885045c3e req-74b7fca9-0470-46a4-9d31-32dd67d8b6d5 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:38.593242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-ada94e4a-d4ed-4120-a672-08f885045c3e req-74b7fca9-0470-46a4-9d31-32dd67d8b6d5 service nova] Creating event network-vif-plugged:c862dfa3-6aa6-4cab-93b9-32edb81d2255 for instance eeb0f710-ce83-4f45-8509-d66fc6a2d628 on hv-cinder-76015 Sep 15 04:30:38.606818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-ada94e4a-d4ed-4120-a672-08f885045c3e req-74b7fca9-0470-46a4-9d31-32dd67d8b6d5 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080141 Sep 15 04:30:38.609821 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 528/1021] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:30:38.714121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:38.723186 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-a9dfa64c-6640-4a93-952f-8724b7b20dc2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.289137 Sep 15 04:30:38.733023 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 494/1022] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:38 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:30:39.741367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:39.742722 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:39.749398 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:39.750075 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:39.751038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:39.751668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:39.897954 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:39.906558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-58dce040-b21a-4f57-9960-6439f8fe31ed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1318 microversion: 2.1 time: 0.169626 Sep 15 04:30:39.907445 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 529/1023] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:39 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:40.924076 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:40.925996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:40.932084 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:40.932920 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:40.934050 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:40.934494 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:41.074638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:41.083121 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-8505bcc3-ffac-4bcd-8f7c-7021e5095b86 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1508 microversion: 2.1 time: 0.162956 Sep 15 04:30:41.083731 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 495/1024] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:40 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:42.506038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d096b77-7528-4154-bd37-e225cb98ad14"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:42.507961 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:42.515293 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:42.516054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:42.517081 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:42.517599 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:42.785811 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-68a2dc87-b259-4660-89a5-a4aa938ddcd2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283599 Sep 15 04:30:42.791633 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 530/1025] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:30:42 2021] POST /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:30:49.319397 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1361304443", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "64c23034-54e2-4845-8c25-1dac43a92296"}]}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:49.369595 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.network.neutron [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] validate_networks() for [('64c23034-54e2-4845-8c25-1dac43a92296', None, None, None, None, None)] {{(pid=108181) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:30:49.721855 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:30:49.722272 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image limits 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:30:49.722742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:30:49.723160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image pref 0:0:0 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:30:49.723574 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.virt.hardware [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:30:49.732015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:49.732455 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:49.733285 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:49.733722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:49.750535 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:30:49.755177 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.quota [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for user eae6fea0ede0479490cf297d39126b27 and project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:30:49.765885 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Going to run 1 instances... {{(pid=108181) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:30:49.768694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:30:49.812722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fbd98791-4dd0-4b13-8f73-a14b019fd62e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497122 Sep 15 04:30:49.813751 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 496/1026] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:30:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:30:49.824780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7c86037d-02aa-4b05-b4dd-bb8cb87e2bf8 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:49.825491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7c86037d-02aa-4b05-b4dd-bb8cb87e2bf8 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:49.877145 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-7c86037d-02aa-4b05-b4dd-bb8cb87e2bf8 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:49.884420 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7c86037d-02aa-4b05-b4dd-bb8cb87e2bf8 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1218 microversion: 2.1 time: 0.064092 Sep 15 04:30:49.884985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 531/1027] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:49 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:50.901104 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:50.901727 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:50.907526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:50.907983 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:50.908795 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:50.909242 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:50.969884 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:50.982403 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c1844562-6489-44c3-b5a7-4e080323f0fb tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1270 microversion: 2.1 time: 0.084929 Sep 15 04:30:50.983308 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 497/1028] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:50 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:51.999712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:52.001589 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:52.009240 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:52.009772 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:52.010936 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:52.011730 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:52.145172 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:52.153819 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-03e4a5ea-51ec-48cd-8cd6-517a11f83145 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.157899 Sep 15 04:30:52.154719 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 532/1029] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:51 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:52.390715 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-f525aec1-313f-4d76-9c54-2253ce04c308 req-54a92341-6594-4ee8-9b6c-9f30e18c508d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91e24964-34e0-4da8-8126-44bdfa3a64f3", "tag": "1a45a4a4-327a-4635-bf48-fcff0a312e94"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:52.392528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:52.392528 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:52.399901 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-f525aec1-313f-4d76-9c54-2253ce04c308 req-54a92341-6594-4ee8-9b6c-9f30e18c508d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:52.400653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-f525aec1-313f-4d76-9c54-2253ce04c308 req-54a92341-6594-4ee8-9b6c-9f30e18c508d service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:52.422029 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-f525aec1-313f-4d76-9c54-2253ce04c308 req-54a92341-6594-4ee8-9b6c-9f30e18c508d service nova] Creating event network-changed:1a45a4a4-327a-4635-bf48-fcff0a312e94 for instance 91e24964-34e0-4da8-8126-44bdfa3a64f3 on hv-cinder-76015 Sep 15 04:30:52.427841 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-f525aec1-313f-4d76-9c54-2253ce04c308 req-54a92341-6594-4ee8-9b6c-9f30e18c508d service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040926 Sep 15 04:30:52.428622 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 498/1030] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:53.171170 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:53.171876 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:53.178949 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:53.179435 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:53.180209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:53.180649 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:53.303796 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:53.310878 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cfd63bfa-cc47-45dc-82a8-95df255a2f51 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.143454 Sep 15 04:30:53.311468 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 533/1031] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:53 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:54.328840 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:54.329576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:54.336665 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:54.337115 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:54.337879 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:54.338318 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:54.464155 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:54.472440 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fe0dfae5-720f-472a-b40b-5b74332fb16e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.146542 Sep 15 04:30:54.473009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 499/1032] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:54 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:55.489657 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:55.490367 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:55.496214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:55.496746 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:55.497536 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:55.497978 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:55.617963 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:55.625311 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2b97760e-8b39-40da-b9af-73bd6654fa7a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.140004 Sep 15 04:30:55.625918 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 534/1033] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:55 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:56.641653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:56.642274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:56.648738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:56.649192 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:56.649968 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:56.650406 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:56.774274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:56.781500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fcbce3bc-34dd-48ae-8798-4f99f17cb87a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.143583 Sep 15 04:30:56.782058 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 500/1034] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:56 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:57.797583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:57.798274 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:57.804572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:57.805014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:57.805782 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:57.806217 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:57.929441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:57.936737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-30420a53-2be0-4ca1-a0db-4641e08e138e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.142871 Sep 15 04:30:57.937396 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 535/1035] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:57 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:30:58.216375 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-553e6adc-b37e-4d0c-a43b-c762d96e629b req-1e54a0dd-2afb-41ef-9b5c-b9019b4a8b40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e24964-34e0-4da8-8126-44bdfa3a64f3", "name": "network-vif-plugged", "status": "completed", "tag": "1a45a4a4-327a-4635-bf48-fcff0a312e94"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:30:58.217872 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:30:58.217872 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:30:58.225592 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-553e6adc-b37e-4d0c-a43b-c762d96e629b req-1e54a0dd-2afb-41ef-9b5c-b9019b4a8b40 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:58.226046 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-553e6adc-b37e-4d0c-a43b-c762d96e629b req-1e54a0dd-2afb-41ef-9b5c-b9019b4a8b40 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:58.237688 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-553e6adc-b37e-4d0c-a43b-c762d96e629b req-1e54a0dd-2afb-41ef-9b5c-b9019b4a8b40 service nova] Creating event network-vif-plugged:1a45a4a4-327a-4635-bf48-fcff0a312e94 for instance 91e24964-34e0-4da8-8126-44bdfa3a64f3 on hv-cinder-76015 Sep 15 04:30:58.243796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-553e6adc-b37e-4d0c-a43b-c762d96e629b req-1e54a0dd-2afb-41ef-9b5c-b9019b4a8b40 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031296 Sep 15 04:30:58.245019 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 501/1036] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:30:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:30:58.954263 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:30:58.954926 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:30:58.961254 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:58.961701 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:58.962469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:30:58.962899 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:30:59.084607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:30:59.091914 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-35687d59-8d1f-4337-a701-86f68fa6e4d4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1318 microversion: 2.1 time: 0.141310 Sep 15 04:30:59.092514 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 536/1037] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:30:58 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:00.109476 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:00.110168 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:00.116714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.117154 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.117912 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.118345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.237009 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:00.244387 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-17ecaf34-aa88-476a-a92c-201f6881bb8d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1508 microversion: 2.1 time: 0.139113 Sep 15 04:31:00.244961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 502/1038] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:00 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1508 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:00.260501 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d096b77-7528-4154-bd37-e225cb98ad14"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:00.261619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:00.267331 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.267780 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.268548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.270083 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.352414 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Invalid volume: volume 5d096b77-7528-4154-bd37-e225cb98ad14 is already attached to instances: eeb0f710-ce83-4f45-8509-d66fc6a2d628 Sep 15 04:31:00.353026 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 400 to user: Invalid volume: volume 5d096b77-7528-4154-bd37-e225cb98ad14 is already attached to instances: eeb0f710-ce83-4f45-8509-d66fc6a2d628 {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:00.353866 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-4aa60899-5bee-4217-9e25-704bf0dd1a88 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097282 Sep 15 04:31:00.354416 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 537/1039] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:31:00 2021] POST /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 04:31:00.416544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:00.417033 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:00.422793 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.423292 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.424050 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.424479 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.507321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'services' on Instance uuid eeb0f710-ce83-4f45-8509-d66fc6a2d628 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:00.570730 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4788c3f1-1433-4dc3-8ca7-4bc58ea4c657 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments/5d096b77-7528-4154-bd37-e225cb98ad14" status: 202 len: 0 microversion: 2.1 time: 0.157710 Sep 15 04:31:00.571442 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 503/1040] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:31:00 2021] DELETE /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments/5d096b77-7528-4154-bd37-e225cb98ad14 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:31:00.579494 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:00.580647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:00.587154 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.587605 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.588391 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:00.588832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:00.619353 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-af580854-93e9-4a34-8838-07a2932cfb77 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Sep 15 04:31:00.619922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 538/1041] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:00 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:01.631633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:01.632656 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:01.638630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:01.639073 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:01.639859 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:01.640290 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:01.668418 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-491c386e-6ff6-4cab-9c0f-b3e86ba8280c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041369 Sep 15 04:31:01.668882 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 504/1042] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:01 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:31:01.818213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-245258705", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "64c23034-54e2-4845-8c25-1dac43a92296"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:01.868267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] validate_networks() for [('64c23034-54e2-4845-8c25-1dac43a92296', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:31:02.235755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:31:02.236180 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:31:02.236654 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:31:02.237058 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:31:02.237522 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:31:02.246244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:02.246699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:02.247537 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:02.247972 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:02.264834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:31:02.270619 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for user eae6fea0ede0479490cf297d39126b27 and project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:31:02.282529 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:31:02.284963 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:31:02.334009 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7e4aa9a9-21dc-49cb-81f3-9cb2ac6b3bed tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519490 Sep 15 04:31:02.334884 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 539/1043] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:31:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:31:02.344722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-ecf26f92-5ba6-4c8d-8603-86ca62387585 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:02.345402 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-ecf26f92-5ba6-4c8d-8603-86ca62387585 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:02.433971 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-ecf26f92-5ba6-4c8d-8603-86ca62387585 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:02.442334 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ecf26f92-5ba6-4c8d-8603-86ca62387585 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1217 microversion: 2.1 time: 0.100320 Sep 15 04:31:02.442907 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 505/1044] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:02 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:03.459091 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:03.460200 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:03.466219 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:03.466748 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:03.467646 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:03.468086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:03.528737 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:03.536359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0e90be75-5cd4-43e8-a551-696bde4f311f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1275 microversion: 2.1 time: 0.081868 Sep 15 04:31:03.536950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 540/1045] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:03 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1275 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:04.500810 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-406add7c-14e7-419b-b989-5d8432f620da req-4a63ba65-a3be-4566-bf5c-709c5f38b599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6002481-6cd1-4abb-bef0-5227b55c5df5", "tag": "357505c8-accc-4cfe-87ed-fdd6696c00d5"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:04.502356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:04.502356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:04.510120 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-406add7c-14e7-419b-b989-5d8432f620da req-4a63ba65-a3be-4566-bf5c-709c5f38b599 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:04.510638 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-406add7c-14e7-419b-b989-5d8432f620da req-4a63ba65-a3be-4566-bf5c-709c5f38b599 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:04.522363 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-406add7c-14e7-419b-b989-5d8432f620da req-4a63ba65-a3be-4566-bf5c-709c5f38b599 service nova] Creating event network-changed:357505c8-accc-4cfe-87ed-fdd6696c00d5 for instance e6002481-6cd1-4abb-bef0-5227b55c5df5 on hv-cinder-76015 Sep 15 04:31:04.526996 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-406add7c-14e7-419b-b989-5d8432f620da req-4a63ba65-a3be-4566-bf5c-709c5f38b599 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029991 Sep 15 04:31:04.527692 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 506/1046] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:04.552749 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:04.553451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:04.559203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:04.559661 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:04.560437 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:04.560909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:04.686767 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:04.695425 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-78e05a69-016f-4985-9430-a726ff339ab4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.147056 Sep 15 04:31:04.695997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 541/1047] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:04 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:05.711843 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:05.712530 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:05.718593 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:05.719030 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:05.719816 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:05.720245 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:05.837649 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:05.844806 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f1a2fba2-d243-4ad8-b53b-02b38dc72b42 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.136957 Sep 15 04:31:05.845362 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 507/1048] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:05 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:06.862056 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:06.863399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:06.869744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:06.870192 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:06.870987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:06.871454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:06.986805 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:06.994471 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-bf9bc1ba-d7c5-4dcc-b45c-2ef031c44421 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.136346 Sep 15 04:31:06.995025 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 542/1049] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:06 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:08.011719 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:08.012332 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:08.018084 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:08.018529 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:08.019325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:08.019761 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:08.142379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:08.150366 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-67cf8d1c-6776-486f-958d-cca952672653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.142418 Sep 15 04:31:08.150929 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 508/1050] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:08 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:09.167605 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:09.168244 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:09.174023 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:09.174470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:09.175302 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:09.175741 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:09.292171 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:09.299299 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ff59bf21-a7f1-46b2-88db-81346f9e6eda tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.135330 Sep 15 04:31:09.299861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 543/1051] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:09 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:10.265979 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-c05fdf32-9856-4fea-bef0-08552f5c5571 req-097d2cbd-b184-4ad9-9fa0-d057723dbb3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6002481-6cd1-4abb-bef0-5227b55c5df5", "name": "network-vif-plugged", "status": "completed", "tag": "357505c8-accc-4cfe-87ed-fdd6696c00d5"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:10.267498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:10.267498 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:10.280769 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c05fdf32-9856-4fea-bef0-08552f5c5571 req-097d2cbd-b184-4ad9-9fa0-d057723dbb3e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:10.281209 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c05fdf32-9856-4fea-bef0-08552f5c5571 req-097d2cbd-b184-4ad9-9fa0-d057723dbb3e service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:10.293273 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-c05fdf32-9856-4fea-bef0-08552f5c5571 req-097d2cbd-b184-4ad9-9fa0-d057723dbb3e service nova] Creating event network-vif-plugged:357505c8-accc-4cfe-87ed-fdd6696c00d5 for instance e6002481-6cd1-4abb-bef0-5227b55c5df5 on hv-cinder-76015 Sep 15 04:31:10.298116 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-c05fdf32-9856-4fea-bef0-08552f5c5571 req-097d2cbd-b184-4ad9-9fa0-d057723dbb3e service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035852 Sep 15 04:31:10.298705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 509/1052] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:10.315111 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:10.315868 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:10.322193 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:10.322644 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:10.323454 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:10.324203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:10.450189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:10.458399 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-5ebd468b-0b3d-4e07-be09-550801e92079 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.147079 Sep 15 04:31:10.459032 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 544/1053] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:10 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:11.474938 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:11.475667 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:11.481690 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:11.482133 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:11.482892 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:11.483356 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:11.608272 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:11.616543 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-45a6ee24-6253-4077-8b1c-be68c29f1633 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1317 microversion: 2.1 time: 0.145573 Sep 15 04:31:11.617300 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 510/1054] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:11 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:12.634484 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:12.634999 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:12.640996 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:12.641440 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:12.642195 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:12.642628 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:12.760213 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:12.767421 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-e6998609-a0ef-4f3d-960e-e0047f1b3cd4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1506 microversion: 2.1 time: 0.137360 Sep 15 04:31:12.767975 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 545/1055] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:12 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1506 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:14.090135 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2603e979-cf02-4345-9e2c-56bbc5ef435a"}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:14.091205 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:14.096981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:14.097437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:14.098209 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:14.098652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:14.336576 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-9d6e41a4-2832-4cae-b88f-f9e5e92b4f49 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249949 Sep 15 04:31:14.337179 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 511/1056] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:31:14 2021] POST /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments => generated 194 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:21.843049 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2603e979-cf02-4345-9e2c-56bbc5ef435a"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:21.844235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:21.849946 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:21.850886 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:21.851674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:21.852103 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:21.939874 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Invalid volume: volume 2603e979-cf02-4345-9e2c-56bbc5ef435a is already attached to instances: e6002481-6cd1-4abb-bef0-5227b55c5df5 Sep 15 04:31:21.940470 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 400 to user: Invalid volume: volume 2603e979-cf02-4345-9e2c-56bbc5ef435a is already attached to instances: e6002481-6cd1-4abb-bef0-5227b55c5df5 {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:21.941298 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d68f0aa2-8b8d-423b-b7db-c0d62c1490e2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102155 Sep 15 04:31:21.941834 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 546/1057] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:31:21 2021] POST /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 04:31:22.004764 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:22.005348 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:22.012176 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:22.012630 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:22.013405 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:22.013847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:22.093147 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'services' on Instance uuid e6002481-6cd1-4abb-bef0-5227b55c5df5 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:22.156768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0a549cbe-a440-480f-b6c8-ef565138ff7c tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments/2603e979-cf02-4345-9e2c-56bbc5ef435a" status: 202 len: 0 microversion: 2.1 time: 0.156075 Sep 15 04:31:22.157296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 512/1058] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:31:21 2021] DELETE /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments/2603e979-cf02-4345-9e2c-56bbc5ef435a => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:31:22.167233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:22.168194 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:22.174587 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:22.175038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:22.176621 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:22.177092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:22.208806 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3d389f40-1a1d-45ac-aa8a-f1dec2bad367 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Sep 15 04:31:22.209351 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 547/1059] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:22 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:31:23.221404 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:23.222464 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:23.229024 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:23.229477 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:23.230240 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:23.230679 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:23.261092 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-13ef4d1b-8fbd-4a33-90c2-5d13fbaad755 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043853 Sep 15 04:31:23.261644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 513/1060] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:23 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 15 04:31:23.405649 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-522696858", "imageRef": "0c5d4b64-5a4e-4970-b225-aec0ea3efe22", "flavorRef": "452", "networks": [{"uuid": "64c23034-54e2-4845-8c25-1dac43a92296"}]}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:23.456915 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.network.neutron [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] validate_networks() for [('64c23034-54e2-4845-8c25-1dac43a92296', None, None, None, None, None)] {{(pid=108182) validate_networks /opt/stack/nova/nova/network/neutron.py:2475}} Sep 15 04:31:23.812512 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 15 04:31:23.813199 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image limits 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 15 04:31:23.813731 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Flavor pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 15 04:31:23.814132 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Image pref 0:0:0 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 15 04:31:23.814543 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.virt.hardware [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108182) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 15 04:31:23.822867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:23.823358 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:23.824197 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:23.824642 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:23.841607 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 15 04:31:23.845334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.quota [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Getting quotas for user eae6fea0ede0479490cf297d39126b27 and project 65e4cfe900e446559ef5184fa2f66653. Resources: {'ram', 'instances', 'cores'} {{(pid=108182) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 15 04:31:23.856562 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Going to run 1 instances... {{(pid=108182) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Sep 15 04:31:23.858698 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0c5d4b64-5a4e-4970-b225-aec0ea3efe22',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108182) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Sep 15 04:31:23.901773 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-cc1b4363-9e8e-4cec-a90d-d11c7563acf2 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499839 Sep 15 04:31:23.902410 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 548/1061] 10.222.0.37 () {60 vars in 1147 bytes} [Wed Sep 15 04:31:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 15 04:31:23.912162 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-bf5bde81-81dc-4037-aab8-0f583d01a234 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:23.912887 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-bf5bde81-81dc-4037-aab8-0f583d01a234 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:23.965352 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-bf5bde81-81dc-4037-aab8-0f583d01a234 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:23.972006 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-bf5bde81-81dc-4037-aab8-0f583d01a234 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1217 microversion: 2.1 time: 0.063504 Sep 15 04:31:23.972661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 514/1062] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:23 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:24.990069 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:24.991318 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:24.998837 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:24.999337 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:25.000110 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:25.000563 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:25.062411 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:25.070248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c95c8394-bb9c-40b9-8f4b-e0130bc0095e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1275 microversion: 2.1 time: 0.084364 Sep 15 04:31:25.070854 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 549/1063] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:24 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1275 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:26.094371 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:26.095192 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:26.103379 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:26.103847 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:26.104828 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:26.105316 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:26.111024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-07dd11a5-ed25-4ed2-9081-20e78114f1c2 req-a4d8acf7-f892-4446-b36d-af03bf980b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a02686-3d8c-428b-a76a-d23b7a130c81", "tag": "6f1d50f5-5614-409b-aa69-8d52435d6bf8"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:26.114840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:26.114840 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:31:26.124363 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-07dd11a5-ed25-4ed2-9081-20e78114f1c2 req-a4d8acf7-f892-4446-b36d-af03bf980b96 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:26.125146 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-07dd11a5-ed25-4ed2-9081-20e78114f1c2 req-a4d8acf7-f892-4446-b36d-af03bf980b96 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:26.143778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-07dd11a5-ed25-4ed2-9081-20e78114f1c2 req-a4d8acf7-f892-4446-b36d-af03bf980b96 service nova] Creating event network-changed:6f1d50f5-5614-409b-aa69-8d52435d6bf8 for instance 34a02686-3d8c-428b-a76a-d23b7a130c81 on hv-cinder-76015 Sep 15 04:31:26.149481 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-07dd11a5-ed25-4ed2-9081-20e78114f1c2 req-a4d8acf7-f892-4446-b36d-af03bf980b96 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043415 Sep 15 04:31:26.150296 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 550/1064] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:31:26.233389 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:26.240705 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-5c98a6e3-2ed2-4490-9685-75b00dd37dd1 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1317 microversion: 2.1 time: 0.150717 Sep 15 04:31:26.241274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 515/1065] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:26 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:27.257849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:27.258549 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:27.264552 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:27.265007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:27.265782 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:27.266231 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:27.383652 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:27.390778 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-14326df2-bb8b-4ef9-a009-3250bae3d3ca tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1317 microversion: 2.1 time: 0.136971 Sep 15 04:31:27.391372 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 551/1066] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:27 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:28.407883 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:28.409167 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:28.416168 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:28.416617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:28.417402 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:28.417838 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:28.535628 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:28.543387 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-61311fe9-5425-487d-9764-001834a2d79a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1317 microversion: 2.1 time: 0.139108 Sep 15 04:31:28.543953 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 516/1067] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:28 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:29.559006 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:29.559674 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:29.565806 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:29.566260 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:29.567034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:29.567502 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:29.935119 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:29.942750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-a8423142-f47c-4f5a-a1ea-8fd70b67afaf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1317 microversion: 2.1 time: 0.387451 Sep 15 04:31:29.943336 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 552/1068] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:29 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:30.335483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-c200b365-1814-42d9-8fa6-49407387135e req-be4e1ba8-da26-4ecb-9732-b9d45daaa038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a02686-3d8c-428b-a76a-d23b7a130c81", "name": "network-vif-plugged", "status": "completed", "tag": "6f1d50f5-5614-409b-aa69-8d52435d6bf8"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:30.336981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:30.336981 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:30.344423 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c200b365-1814-42d9-8fa6-49407387135e req-be4e1ba8-da26-4ecb-9732-b9d45daaa038 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:30.344872 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c200b365-1814-42d9-8fa6-49407387135e req-be4e1ba8-da26-4ecb-9732-b9d45daaa038 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:30.356238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-c200b365-1814-42d9-8fa6-49407387135e req-be4e1ba8-da26-4ecb-9732-b9d45daaa038 service nova] Creating event network-vif-plugged:6f1d50f5-5614-409b-aa69-8d52435d6bf8 for instance 34a02686-3d8c-428b-a76a-d23b7a130c81 on hv-cinder-76015 Sep 15 04:31:30.361090 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-c200b365-1814-42d9-8fa6-49407387135e req-be4e1ba8-da26-4ecb-9732-b9d45daaa038 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029255 Sep 15 04:31:30.361671 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 517/1069] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:31:30.960050 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:30.960761 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:30.967039 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:30.967511 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:30.968275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:30.968706 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:31.083777 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:31.091909 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-b7cc5c24-2787-47cf-8b88-15a4e7797a2e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1317 microversion: 2.1 time: 0.135651 Sep 15 04:31:31.092523 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 553/1070] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:30 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1317 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:32.108834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:32.109563 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:32.115692 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:32.116143 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:32.117546 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:32.117989 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:32.237961 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:32.246454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-55cec4e3-c650-4edb-be09-658b5db26090 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1506 microversion: 2.1 time: 0.141129 Sep 15 04:31:32.246454 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 518/1071] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:32 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1506 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:33.569054 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb2d3629-44ff-4494-853f-e80e318d1e26"}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:33.570869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:33.576640 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:33.577090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:33.577869 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:33.578306 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:33.803450 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-2697c2cc-e9d5-4405-8119-eefae2833a16 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "POST /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237877 Sep 15 04:31:33.804980 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 554/1072] 10.222.0.37 () {60 vars in 1323 bytes} [Wed Sep 15 04:31:33 2021] POST /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:41.403070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:41.403694 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:41.409990 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:41.410435 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:41.411223 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:41.411653 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:41.493078 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'services' on Instance uuid 34a02686-3d8c-428b-a76a-d23b7a130c81 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:41.555483 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b3a2a481-b85d-4377-8b30-874113666953 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments/fb2d3629-44ff-4494-853f-e80e318d1e26" status: 202 len: 0 microversion: 2.1 time: 0.155959 Sep 15 04:31:41.556081 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 519/1073] 10.222.0.37 () {58 vars in 1416 bytes} [Wed Sep 15 04:31:41 2021] DELETE /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments/fb2d3629-44ff-4494-853f-e80e318d1e26 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:31:41.566090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:41.567077 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:41.578275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:41.578739 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:41.579572 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:41.580024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:41.609844 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-33438f36-df0c-4a28-9ee4-4b7b7ba92c1d tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049168 Sep 15 04:31:41.610386 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 555/1074] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:41 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:42.622322 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:42.623460 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:42.629360 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:42.629807 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:42.630582 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:42.631017 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:42.660618 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-23732987-881e-4539-aa3d-2fb47756a596 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042358 Sep 15 04:31:42.661219 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 520/1075] 10.222.0.37 () {58 vars in 1302 bytes} [Wed Sep 15 04:31:42 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 15 04:31:43.845591 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:43.846078 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:43.853252 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:43.853703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:43.854473 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:43.854908 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:43.880985 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:31:43.962465 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-ca52e4a0-4b84-4637-b14b-aa6184428a96 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 204 len: 0 microversion: 2.1 time: 0.120265 Sep 15 04:31:43.963057 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 556/1076] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:31:43 2021] DELETE /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:31:43.972103 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:43.973069 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:43.979786 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:43.980230 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:43.980992 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:43.981449 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:44.103054 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:44.110171 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-15ca6ef8-bd9f-45bc-aaeb-a9205a02cabd tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1512 microversion: 2.1 time: 0.143044 Sep 15 04:31:44.110722 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 521/1077] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:43 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1512 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:45.127369 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:45.128090 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:45.133917 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:45.134359 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:45.135115 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:45.135569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:45.254594 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:45.262093 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-58c5ffe9-0980-4a6f-abaa-dc2b70406653 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1512 microversion: 2.1 time: 0.138583 Sep 15 04:31:45.262548 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 557/1078] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:45 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1512 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:46.212715 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-1f21e8f3-d754-4c79-9108-b3bb822209dc req-dc42ef22-074b-41d0-b3a1-4561f3db0d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a02686-3d8c-428b-a76a-d23b7a130c81", "name": "network-vif-deleted", "tag": "6f1d50f5-5614-409b-aa69-8d52435d6bf8"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:46.214711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:46.214711 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:46.221756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1f21e8f3-d754-4c79-9108-b3bb822209dc req-dc42ef22-074b-41d0-b3a1-4561f3db0d02 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:46.222436 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1f21e8f3-d754-4c79-9108-b3bb822209dc req-dc42ef22-074b-41d0-b3a1-4561f3db0d02 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:46.236013 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-1f21e8f3-d754-4c79-9108-b3bb822209dc req-dc42ef22-074b-41d0-b3a1-4561f3db0d02 service nova] Creating event network-vif-deleted:6f1d50f5-5614-409b-aa69-8d52435d6bf8 for instance 34a02686-3d8c-428b-a76a-d23b7a130c81 on hv-cinder-76015 Sep 15 04:31:46.241099 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-1f21e8f3-d754-4c79-9108-b3bb822209dc req-dc42ef22-074b-41d0-b3a1-4561f3db0d02 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Sep 15 04:31:46.241893 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 522/1079] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:46.280251 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:46.280867 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:46.286912 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:46.287394 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:46.289276 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:46.289699 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:46.333362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:46.333818 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:46.334277 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'fault' on Instance uuid 34a02686-3d8c-428b-a76a-d23b7a130c81 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:46.374727 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:46.382253 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-d2177d40-1ed1-4e6b-94e5-a597091d070a tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 200 len: 1307 microversion: 2.1 time: 0.106065 Sep 15 04:31:46.382825 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 558/1080] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:46 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 1307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:47.399541 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:47.400321 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 34a02686-3d8c-428b-a76a-d23b7a130c81] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:47.406644 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:47.407345 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:47.408296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:47.408734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:47.425834 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Instance 34a02686-3d8c-428b-a76a-d23b7a130c81 could not be found. Sep 15 04:31:47.426421 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 404 to user: Instance 34a02686-3d8c-428b-a76a-d23b7a130c81 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:47.427274 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-35a6a6f2-83f1-4061-bb52-2a08b5f89be4 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81" status: 404 len: 111 microversion: 2.1 time: 0.032121 Sep 15 04:31:47.427796 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 523/1081] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:47 2021] GET /compute/v2.1/servers/34a02686-3d8c-428b-a76a-d23b7a130c81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:31:48.557885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:48.558364 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:48.564791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:48.565234 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:48.565993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:48.566427 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:48.590768 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:31:48.660601 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-83066b9e-b0c3-4709-952d-86f6eb687a08 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 204 len: 0 microversion: 2.1 time: 0.106455 Sep 15 04:31:48.661097 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 559/1082] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:31:48 2021] DELETE /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:31:48.670652 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:48.671341 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:48.677726 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:48.678242 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:48.679637 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:48.680189 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:48.802798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:48.810881 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6545f4d4-cdb6-4f54-ae2c-a04bdd5dce61 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1512 microversion: 2.1 time: 0.144507 Sep 15 04:31:48.811489 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 524/1083] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:48 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1512 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:49.828567 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:49.829281 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:49.835888 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:49.836334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:49.837093 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:49.837521 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:49.955286 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:49.962515 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c122c7f8-dc99-4f30-9bb0-9f35caa1585b tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1512 microversion: 2.1 time: 0.137944 Sep 15 04:31:49.963092 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 560/1084] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:49 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1512 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:50.683633 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-c319fd8a-275f-4e6b-9739-d0ab63c710be req-566243b0-34a9-4f3f-bb8a-3f9682d6e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6002481-6cd1-4abb-bef0-5227b55c5df5", "name": "network-vif-deleted", "tag": "357505c8-accc-4cfe-87ed-fdd6696c00d5"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:50.686350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:50.686350 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:50.695543 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c319fd8a-275f-4e6b-9739-d0ab63c710be req-566243b0-34a9-4f3f-bb8a-3f9682d6e554 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:50.696343 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-c319fd8a-275f-4e6b-9739-d0ab63c710be req-566243b0-34a9-4f3f-bb8a-3f9682d6e554 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:50.710178 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-c319fd8a-275f-4e6b-9739-d0ab63c710be req-566243b0-34a9-4f3f-bb8a-3f9682d6e554 service nova] Creating event network-vif-deleted:357505c8-accc-4cfe-87ed-fdd6696c00d5 for instance e6002481-6cd1-4abb-bef0-5227b55c5df5 on hv-cinder-76015 Sep 15 04:31:50.716437 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-c319fd8a-275f-4e6b-9739-d0ab63c710be req-566243b0-34a9-4f3f-bb8a-3f9682d6e554 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036763 Sep 15 04:31:50.717562 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 525/1085] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:50.979204 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:50.979871 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:50.985690 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:50.986135 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:50.986922 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:50.987384 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:51.018340 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:51.018790 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:51.019266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.objects.instance [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'fault' on Instance uuid e6002481-6cd1-4abb-bef0-5227b55c5df5 {{(pid=108182) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:51.061990 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:51.069852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-1d32d171-0daa-4e83-81a4-be938d360252 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 200 len: 1307 microversion: 2.1 time: 0.094491 Sep 15 04:31:51.070418 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 561/1086] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:50 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:52.087575 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:52.088263 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: e6002481-6cd1-4abb-bef0-5227b55c5df5] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:52.094298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.094741 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.095526 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.095959 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.108430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Instance e6002481-6cd1-4abb-bef0-5227b55c5df5 could not be found. Sep 15 04:31:52.109003 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 404 to user: Instance e6002481-6cd1-4abb-bef0-5227b55c5df5 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:52.109794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-11aff94c-cecb-414f-86a8-ab1f751eb6ec tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5" status: 404 len: 111 microversion: 2.1 time: 0.027011 Sep 15 04:31:52.110307 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 526/1087] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:52 2021] GET /compute/v2.1/servers/e6002481-6cd1-4abb-bef0-5227b55c5df5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:31:52.118220 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:52.118712 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:52.124524 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.124975 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.125755 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.126248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.153910 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:31:52.226525 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-c4b3a37a-7648-4cf8-a198-db011572cb3f tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 204 len: 0 microversion: 2.1 time: 0.111839 Sep 15 04:31:52.227528 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 562/1088] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:31:52 2021] DELETE /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:31:52.235944 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:52.236798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:52.243629 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.244070 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.244831 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:52.245262 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:52.369837 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:52.377164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7178e78f-9314-40bc-8444-edd072b32d81 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1514 microversion: 2.1 time: 0.145175 Sep 15 04:31:52.377725 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 527/1089] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:52 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:31:53.395558 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:53.396255 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:53.402738 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:53.403242 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:53.404014 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:53.404451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:53.529398 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:53.536696 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-298367b5-21d8-42c2-b4ba-d943f1acf635 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 200 len: 1514 microversion: 2.1 time: 0.145140 Sep 15 04:31:53.537269 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 563/1090] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:53 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:53.983544 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-93c50917-4b5b-4763-99b9-5ead43b33a6e req-51034b27-ada9-440a-aec5-846b0360f445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91e24964-34e0-4da8-8126-44bdfa3a64f3", "name": "network-vif-deleted", "tag": "1a45a4a4-327a-4635-bf48-fcff0a312e94"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:53.985182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:53.985182 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:31:53.992860 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-93c50917-4b5b-4763-99b9-5ead43b33a6e req-51034b27-ada9-440a-aec5-846b0360f445 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:53.993400 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-93c50917-4b5b-4763-99b9-5ead43b33a6e req-51034b27-ada9-440a-aec5-846b0360f445 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:54.005469 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-93c50917-4b5b-4763-99b9-5ead43b33a6e req-51034b27-ada9-440a-aec5-846b0360f445 service nova] Creating event network-vif-deleted:1a45a4a4-327a-4635-bf48-fcff0a312e94 for instance 91e24964-34e0-4da8-8126-44bdfa3a64f3 on hv-cinder-76015 Sep 15 04:31:54.012032 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-93c50917-4b5b-4763-99b9-5ead43b33a6e req-51034b27-ada9-440a-aec5-846b0360f445 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032227 Sep 15 04:31:54.012975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 528/1091] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:54.553249 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:54.553791 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: 91e24964-34e0-4da8-8126-44bdfa3a64f3] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:54.559610 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:54.560056 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:54.560815 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:54.561246 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:54.574248 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Instance 91e24964-34e0-4da8-8126-44bdfa3a64f3 could not be found. Sep 15 04:31:54.574847 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 404 to user: Instance 91e24964-34e0-4da8-8126-44bdfa3a64f3 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:54.575682 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-215dbb26-fcf8-4c22-8508-ca8a0afa8260 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3" status: 404 len: 111 microversion: 2.1 time: 0.026263 Sep 15 04:31:54.576189 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 564/1092] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:54 2021] GET /compute/v2.1/servers/91e24964-34e0-4da8-8126-44bdfa3a64f3 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:31:55.709215 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:55.709798 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:55.716315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:55.716791 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:55.717556 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:55.718022 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:55.742199 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:31:55.816858 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-7f2c07c4-a388-4102-bfb0-730f3479834e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "DELETE /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 204 len: 0 microversion: 2.1 time: 0.111003 Sep 15 04:31:55.817794 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 529/1093] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:31:55 2021] DELETE /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:31:55.825950 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:55.826592 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:55.832375 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:55.832816 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:55.833575 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:55.834003 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:55.951034 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:55.958275 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-726c9af9-f3d3-4463-bf9d-858aff24ffcf tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1514 microversion: 2.1 time: 0.136053 Sep 15 04:31:55.958833 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 565/1094] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:55 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1514 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:56.975625 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:56.976325 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:56.982736 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:56.983217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:56.983986 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:56.984420 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:57.108387 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:57.115737 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-d5e6aef6-57ce-40f2-bb55-1f61f205a473 tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1514 microversion: 2.1 time: 0.144170 Sep 15 04:31:57.116296 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 530/1095] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:56 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:57.730789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-78f541a4-aa43-43b4-9dc8-807451d4121f req-b9ad5be6-2aee-4f25-80b5-5d6d84456cac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb0f710-ce83-4f45-8509-d66fc6a2d628", "name": "network-vif-deleted", "tag": "c862dfa3-6aa6-4cab-93b9-32edb81d2255"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:31:57.732576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:31:57.732576 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:31:57.741214 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-78f541a4-aa43-43b4-9dc8-807451d4121f req-b9ad5be6-2aee-4f25-80b5-5d6d84456cac service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:57.741729 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-78f541a4-aa43-43b4-9dc8-807451d4121f req-b9ad5be6-2aee-4f25-80b5-5d6d84456cac service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:57.754327 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-78f541a4-aa43-43b4-9dc8-807451d4121f req-b9ad5be6-2aee-4f25-80b5-5d6d84456cac service nova] Creating event network-vif-deleted:c862dfa3-6aa6-4cab-93b9-32edb81d2255 for instance eeb0f710-ce83-4f45-8509-d66fc6a2d628 on hv-cinder-76015 Sep 15 04:31:57.759267 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-78f541a4-aa43-43b4-9dc8-807451d4121f req-b9ad5be6-2aee-4f25-80b5-5d6d84456cac service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033019 Sep 15 04:31:57.759856 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 566/1096] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:31:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:31:58.131523 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:58.132139 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:58.138358 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:58.138811 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:58.139723 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:58.140051 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:58.173918 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:58.174383 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:58.174836 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.objects.instance [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lazy-loading 'fault' on Instance uuid eeb0f710-ce83-4f45-8509-d66fc6a2d628 {{(pid=108181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 15 04:31:58.215738 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae6fea0ede0479490cf297d39126b27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65e4cfe900e446559ef5184fa2f66653', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:31:58.222446 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-b3ad1160-9626-41bd-b35f-bb10a8175bde tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 200 len: 1308 microversion: 2.1 time: 0.094591 Sep 15 04:31:58.223060 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 531/1097] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:58 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:31:59.240000 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:31:59.240695 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] [instance: eeb0f710-ce83-4f45-8509-d66fc6a2d628] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:31:59.247447 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:59.247892 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:59.248647 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:31:59.249080 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:31:59.261987 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] HTTP exception thrown: Instance eeb0f710-ce83-4f45-8509-d66fc6a2d628 could not be found. Sep 15 04:31:59.262566 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] Returning 404 to user: Instance eeb0f710-ce83-4f45-8509-d66fc6a2d628 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:31:59.263492 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-3398b05c-de03-40b3-a3d1-b2310989bf5e tempest-AttachVolumeNegativeTest-519339298 tempest-AttachVolumeNegativeTest-519339298-project] 10.222.0.37 "GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628" status: 404 len: 111 microversion: 2.1 time: 0.027363 Sep 15 04:31:59.264016 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 567/1098] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:31:59 2021] GET /compute/v2.1/servers/eeb0f710-ce83-4f45-8509-d66fc6a2d628 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:00.843583 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1ad72fc9-62aa-4895-a476-d86ff0a5bfc7 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Action: 'create', calling method: .version_select at 0x7f02a2a94280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1471838560", "metadata": {"Type": "work"}}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:00.845199 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1ad72fc9-62aa-4895-a476-d86ff0a5bfc7 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:00.846095 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1ad72fc9-62aa-4895-a476-d86ff0a5bfc7 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.111616 Sep 15 04:32:00.846610 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 532/1099] 10.222.0.37 () {60 vars in 1156 bytes} [Wed Sep 15 04:32:00 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 04:32:00.855617 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0e954cd7-1c9f-4329-a2b8-5476a5b415b6 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Action: 'create', calling method: .version_select at 0x7f02a46b38b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1114885934", "metadata": {"Type": "work"}}} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:00.857048 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-0e954cd7-1c9f-4329-a2b8-5476a5b415b6 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:00.857841 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-0e954cd7-1c9f-4329-a2b8-5476a5b415b6 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006110 Sep 15 04:32:00.858334 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 568/1100] 10.222.0.37 () {60 vars in 1156 bytes} [Wed Sep 15 04:32:00 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 15 04:32:00.866139 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-daf1e40d-c3b5-4900-8270-011f8fcb640e tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Action: 'create', calling method: .version_select at 0x7f02a2ac1ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-977041894", "metadata": {"Type": "work"}}} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:00.867342 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-daf1e40d-c3b5-4900-8270-011f8fcb640e tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:00.868106 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-daf1e40d-c3b5-4900-8270-011f8fcb640e tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005444 Sep 15 04:32:00.868579 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 533/1101] 10.222.0.37 () {60 vars in 1156 bytes} [Wed Sep 15 04:32:00 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 15 04:32:00.876061 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-65fecac9-f36e-4b55-bb9b-6a35f238efbb tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Calling method '.version_select at 0x7f02a206c3a0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:00.904203 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-65fecac9-f36e-4b55-bb9b-6a35f238efbb tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] HTTP exception thrown: Volume tempest-invalid-961488331 could not be found. Sep 15 04:32:00.904826 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-65fecac9-f36e-4b55-bb9b-6a35f238efbb tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 404 to user: Volume tempest-invalid-961488331 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:00.905703 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-65fecac9-f36e-4b55-bb9b-6a35f238efbb tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/tempest-invalid-961488331" status: 404 len: 98 microversion: 2.1 time: 0.032794 Sep 15 04:32:00.906238 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 569/1102] 10.222.0.37 () {58 vars in 1215 bytes} [Wed Sep 15 04:32:00 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-961488331 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 15 04:32:00.917672 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-ebe9aa9b-ce76-4b85-9bc9-df1ceeaa5d6f tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006044 Sep 15 04:32:00.918159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 534/1103] 10.222.0.37 () {58 vars in 1140 bytes} [Wed Sep 15 04:32:00 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 04:32:00.925956 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-33e614d5-cc81-40db-a925-7715b6ec2121 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003461 Sep 15 04:32:00.926441 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 570/1104] 10.222.0.37 () {58 vars in 1137 bytes} [Wed Sep 15 04:32:00 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 15 04:32:00.934031 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-437ca0b4-6dac-4bb6-b6b8-7feddde586ef tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Calling method '.version_select at 0x7f02a2a940d0>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:00.960445 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-437ca0b4-6dac-4bb6-b6b8-7feddde586ef tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] HTTP exception thrown: Volume 7338e5c7-5020-442e-be3b-d1c4263823a3 could not be found. Sep 15 04:32:00.961756 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-437ca0b4-6dac-4bb6-b6b8-7feddde586ef tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 404 to user: Volume 7338e5c7-5020-442e-be3b-d1c4263823a3 could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:00.962754 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-437ca0b4-6dac-4bb6-b6b8-7feddde586ef tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "DELETE /compute/v2.1/os-volumes/7338e5c7-5020-442e-be3b-d1c4263823a3" status: 404 len: 109 microversion: 2.1 time: 0.031963 Sep 15 04:32:00.963287 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 535/1105] 10.222.0.37 () {58 vars in 1248 bytes} [Wed Sep 15 04:32:00 2021] DELETE /compute/v2.1/os-volumes/7338e5c7-5020-442e-be3b-d1c4263823a3 => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 15 04:32:00.971844 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07454b76-fd49-424f-a035-446ef5557869 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Calling method '.version_select at 0x7f02a20b7af0>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:01.000270 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-07454b76-fd49-424f-a035-446ef5557869 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] HTTP exception thrown: Volume 608dd872-132a-43b5-85ce-beebe608d7d4 could not be found. Sep 15 04:32:01.000852 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-07454b76-fd49-424f-a035-446ef5557869 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] Returning 404 to user: Volume 608dd872-132a-43b5-85ce-beebe608d7d4 could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:01.001673 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-07454b76-fd49-424f-a035-446ef5557869 tempest-VolumesNegativeTest-707345205 tempest-VolumesNegativeTest-707345205-project] 10.222.0.37 "GET /compute/v2.1/os-volumes/608dd872-132a-43b5-85ce-beebe608d7d4" status: 404 len: 109 microversion: 2.1 time: 0.033415 Sep 15 04:32:01.002206 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 571/1106] 10.222.0.37 () {58 vars in 1245 bytes} [Wed Sep 15 04:32:00 2021] GET /compute/v2.1/os-volumes/608dd872-132a-43b5-85ce-beebe608d7d4 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:07.941165 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:07.941717 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:07.942740 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-7412ede5-10b1-4021-991d-5e45782056d1 req-6cf1fbce-68c1-4232-b0e9-9522b8f385da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb", "tag": "67ae3844-b7f5-4228-af9f-4ec1589504d6"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:07.946038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:32:07.946038 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:32:07.948742 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:07.949273 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:07.950122 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:07.950660 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:07.953024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-7412ede5-10b1-4021-991d-5e45782056d1 req-6cf1fbce-68c1-4232-b0e9-9522b8f385da service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:07.953789 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-7412ede5-10b1-4021-991d-5e45782056d1 req-6cf1fbce-68c1-4232-b0e9-9522b8f385da service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:07.965230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-7412ede5-10b1-4021-991d-5e45782056d1 req-6cf1fbce-68c1-4232-b0e9-9522b8f385da service nova] Creating event network-changed:67ae3844-b7f5-4228-af9f-4ec1589504d6 for instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb on hv-cinder-76015 Sep 15 04:32:07.970362 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-7412ede5-10b1-4021-991d-5e45782056d1 req-6cf1fbce-68c1-4232-b0e9-9522b8f385da service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031145 Sep 15 04:32:07.971174 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 572/1107] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:32:07.981431 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Going to try to terminate instance {{(pid=108181) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:32:08.062788 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-1e4f6e6a-5a87-4df6-9add-c06556e5dd17 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "DELETE /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 204 len: 0 microversion: 2.1 time: 0.125891 Sep 15 04:32:08.064260 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 536/1108] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:32:07 2021] DELETE /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:32:08.074230 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:08.075565 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:08.084257 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:08.084711 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:08.087060 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:08.087993 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:08.213546 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:08.221309 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-22149a5c-9d7d-4eda-92da-3630a0fbd114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1578 microversion: 2.1 time: 0.152585 Sep 15 04:32:08.222164 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 573/1109] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:08 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1578 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 15 04:32:09.239792 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:09.240419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:09.246149 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:09.246590 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:09.247369 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:09.247799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:09.366297 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:09.374160 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-4b87044d-5c0a-42c7-90cd-91f244d46f38 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1460 microversion: 2.1 time: 0.138402 Sep 15 04:32:09.374734 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 537/1110] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:09 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1460 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:10.391569 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:10.392183 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:10.397997 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:10.399088 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:10.399885 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:10.400330 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:10.522365 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:10.530188 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-28b3a0b1-1c17-4ed5-9727-fecef4d43c4c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1460 microversion: 2.1 time: 0.142231 Sep 15 04:32:10.530744 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 574/1111] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:10 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1460 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:11.546564 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:11.547198 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:11.553047 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:11.553500 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:11.554326 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:11.555511 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:11.672096 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:11.679298 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-c0057a21-b743-4257-8fbb-cf20ffb22b14 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1460 microversion: 2.1 time: 0.136408 Sep 15 04:32:11.680117 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 538/1112] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:11 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1460 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:12.697172 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:12.697781 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:12.703693 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:12.704750 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:12.707237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:12.707237 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:12.756021 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-52c0be80-4656-4d8e-9ad6-efd35ad043be req-4e72a0b2-505d-4ed7-887a-37ab93a4a01b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb", "name": "network-vif-deleted", "tag": "67ae3844-b7f5-4228-af9f-4ec1589504d6"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:12.757856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:32:12.757856 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:32:12.765527 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-52c0be80-4656-4d8e-9ad6-efd35ad043be req-4e72a0b2-505d-4ed7-887a-37ab93a4a01b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:12.765969 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-52c0be80-4656-4d8e-9ad6-efd35ad043be req-4e72a0b2-505d-4ed7-887a-37ab93a4a01b service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:12.775446 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:12.779197 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-52c0be80-4656-4d8e-9ad6-efd35ad043be req-4e72a0b2-505d-4ed7-887a-37ab93a4a01b service nova] Creating event network-vif-deleted:67ae3844-b7f5-4228-af9f-4ec1589504d6 for instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb on hv-cinder-76015 Sep 15 04:32:12.783975 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-52c0be80-4656-4d8e-9ad6-efd35ad043be req-4e72a0b2-505d-4ed7-887a-37ab93a4a01b service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031533 Sep 15 04:32:12.784891 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 539/1113] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:32:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:32:12.785031 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-28c5591b-efdf-4581-a136-5a88d9172c28 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 200 len: 1392 microversion: 2.1 time: 0.092049 Sep 15 04:32:12.785493 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 575/1114] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:12 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 1392 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:13.803822 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:13.804818 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:13.810833 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:13.811315 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:13.812074 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:13.812506 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:13.826782 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] HTTP exception thrown: Instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb could not be found. Sep 15 04:32:13.827430 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Returning 404 to user: Instance 34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:13.828241 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-6081666b-27bb-4ccf-b76c-c2af1ea3b86f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb" status: 404 len: 111 microversion: 2.1 time: 0.028443 Sep 15 04:32:13.828768 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 540/1115] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:13 2021] GET /compute/v2.1/servers/34a87835-d6bc-4bf9-aa96-bc5f8e5cfccb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:18.941030 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:18.941604 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:18.944586 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [req-1356c1d5-6ed5-439c-8fec-d5aca78cc34d req-4adb834e-4f97-4a0d-8253-ab8f7fe7972f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e944779f-4589-42ae-9de4-95c27db55bda", "tag": "62fee7db-47a8-40e5-8d05-015c16397921"}]} {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:18.946661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:32:18.946661 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: warnings.warn(msg) Sep 15 04:32:18.948007 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:18.948456 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:18.949233 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:18.949668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:18.954238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1356c1d5-6ed5-439c-8fec-d5aca78cc34d req-4adb834e-4f97-4a0d-8253-ab8f7fe7972f service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:18.954771 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [req-1356c1d5-6ed5-439c-8fec-d5aca78cc34d req-4adb834e-4f97-4a0d-8253-ab8f7fe7972f service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:18.965800 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.compute.server_external_events [req-1356c1d5-6ed5-439c-8fec-d5aca78cc34d req-4adb834e-4f97-4a0d-8253-ab8f7fe7972f service nova] Creating event network-changed:62fee7db-47a8-40e5-8d05-015c16397921 for instance e944779f-4589-42ae-9de4-95c27db55bda on hv-cinder-76015 Sep 15 04:32:18.971295 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [req-1356c1d5-6ed5-439c-8fec-d5aca78cc34d req-4adb834e-4f97-4a0d-8253-ab8f7fe7972f service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Sep 15 04:32:18.971965 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 541/1116] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 15 04:32:18.976402 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Going to try to terminate instance {{(pid=108182) delete /opt/stack/nova/nova/compute/api.py:2612}} Sep 15 04:32:19.057477 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-7a652008-7195-4e94-aab9-816c452dc114 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "DELETE /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 204 len: 0 microversion: 2.1 time: 0.119909 Sep 15 04:32:19.058229 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 576/1117] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:32:18 2021] DELETE /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 15 04:32:19.067180 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:19.068025 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:19.075349 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:19.075888 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:19.076753 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:19.077265 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:19.205291 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:19.213848 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-daab602b-b14a-44fa-982a-664dec142f0c tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1577 microversion: 2.1 time: 0.151062 Sep 15 04:32:19.214419 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 542/1118] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:19 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:20.230718 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:20.231436 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:20.237209 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:20.237660 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:20.238418 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:20.238849 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:20.356794 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:20.364029 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-312fe3e2-1256-4f50-8886-eaff1d70aa6d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1459 microversion: 2.1 time: 0.137952 Sep 15 04:32:20.364588 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 577/1119] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:20 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1459 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:21.381187 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:21.381799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:21.388784 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:21.389238 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:21.390004 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:21.390439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:21.513799 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:21.521015 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-fe6f4f7e-0aee-40cd-af97-86de3a31797f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1459 microversion: 2.1 time: 0.143506 Sep 15 04:32:21.521578 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 543/1120] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:21 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1459 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:22.537861 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:22.538639 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:22.544859 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:22.545310 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:22.546086 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:22.546527 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:22.666526 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.policy [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108182) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:22.674024 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-457800b0-4095-4bbd-8103-5e00a89b285f tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1459 microversion: 2.1 time: 0.139827 Sep 15 04:32:22.674583 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 578/1121] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:22 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1459 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:23.689949 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:23.690573 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:23.694704 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [req-088ebb4c-c734-4149-9936-54f0ba6306e6 req-8dc919a1-0e13-4856-ad5a-94fee9519cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e944779f-4589-42ae-9de4-95c27db55bda", "name": "network-vif-deleted", "tag": "62fee7db-47a8-40e5-8d05-015c16397921"}]} {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 15 04:32:23.696495 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 04:32:23.696495 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: warnings.warn(msg) Sep 15 04:32:23.696782 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:23.697439 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:23.698493 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:23.698946 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:23.704711 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-088ebb4c-c734-4149-9936-54f0ba6306e6 req-8dc919a1-0e13-4856-ad5a-94fee9519cd3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:23.705166 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [req-088ebb4c-c734-4149-9936-54f0ba6306e6 req-8dc919a1-0e13-4856-ad5a-94fee9519cd3 service nova] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:23.717957 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.compute.server_external_events [req-088ebb4c-c734-4149-9936-54f0ba6306e6 req-8dc919a1-0e13-4856-ad5a-94fee9519cd3 service nova] Creating event network-vif-deleted:62fee7db-47a8-40e5-8d05-015c16397921 for instance e944779f-4589-42ae-9de4-95c27db55bda on hv-cinder-76015 Sep 15 04:32:23.723721 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [req-088ebb4c-c734-4149-9936-54f0ba6306e6 req-8dc919a1-0e13-4856-ad5a-94fee9519cd3 service nova] 10.222.0.37 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032447 Sep 15 04:32:23.724317 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 579/1122] 10.222.0.37 () {64 vars in 1318 bytes} [Wed Sep 15 04:32:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 15 04:32:23.763243 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.policy [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc599faf327249919f8dc76e65061ae3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c1fb8c3a214f5ba4aacbcfbe2af2e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108181) authorize /opt/stack/nova/nova/policy.py:199}} Sep 15 04:32:23.770845 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-0590485a-55f8-4216-84ef-1d8d48e52548 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 200 len: 1391 microversion: 2.1 time: 0.084891 Sep 15 04:32:23.771451 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 544/1123] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:23 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 1391 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 15 04:32:24.788136 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:24.789320 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: e944779f-4589-42ae-9de4-95c27db55bda] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:24.795287 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:24.795732 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:24.796491 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:24.796923 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:24.810047 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] HTTP exception thrown: Instance e944779f-4589-42ae-9de4-95c27db55bda could not be found. Sep 15 04:32:24.810621 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Returning 404 to user: Instance e944779f-4589-42ae-9de4-95c27db55bda could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:24.811451 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8d847efc-c23a-4882-b27b-d67678aa1b51 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda" status: 404 len: 111 microversion: 2.1 time: 0.027262 Sep 15 04:32:24.811957 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 580/1124] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:24 2021] GET /compute/v2.1/servers/e944779f-4589-42ae-9de4-95c27db55bda => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:25.505714 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:25.506217 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.compute.api [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108181) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:25.512739 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:25.513120 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:25.513874 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:25.514301 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG oslo_concurrency.lockutils [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:25.527591 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.wsgi [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] HTTP exception thrown: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. Sep 15 04:32:25.528164 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Returning 404 to user: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. {{(pid=108181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:25.528963 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-f14727ad-5aa9-4f0d-92c4-2a7fea6b0c73 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "DELETE /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 404 len: 111 microversion: 2.1 time: 0.027030 Sep 15 04:32:25.529472 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 545/1125] 10.222.0.37 () {58 vars in 1239 bytes} [Wed Sep 15 04:32:25 2021] DELETE /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:25.537186 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '>' {{(pid=108182) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:25.537798 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.compute.api [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [instance: 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde] Fetching instance by UUID {{(pid=108182) get /opt/stack/nova/nova/compute/api.py:2863}} Sep 15 04:32:25.544037 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:25.544469 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:25.545226 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 15 04:32:25.545658 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG oslo_concurrency.lockutils [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Lock "9a3677ce-c6a9-4ef3-b7f2-0ef4595815b9" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108182) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 15 04:32:25.558832 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.wsgi [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] HTTP exception thrown: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. Sep 15 04:32:25.559463 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: DEBUG nova.api.openstack.wsgi [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Returning 404 to user: Instance 551493b4-5ef7-4c4d-9b6a-d89dcaf16dde could not be found. {{(pid=108182) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 15 04:32:25.560266 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO nova.api.openstack.requestlog [None req-8eb9f71e-d257-4a02-ad0f-dd55a175123d tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde" status: 404 len: 111 microversion: 2.1 time: 0.026682 Sep 15 04:32:25.560762 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: [pid: 108182|app: 0|req: 581/1126] 10.222.0.37 () {58 vars in 1236 bytes} [Wed Sep 15 04:32:25 2021] GET /compute/v2.1/servers/551493b4-5ef7-4c4d-9b6a-d89dcaf16dde => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 15 04:32:28.942617 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: DEBUG nova.api.openstack.wsgi [None req-663d0208-e105-44f9-b7ff-ff6994d9b6d5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] Calling method '.version_select at 0x7f02a2a6b790>' {{(pid=108181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 15 04:32:28.946012 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: ERROR oslo.messaging._drivers.impl_rabbit [None req-663d0208-e105-44f9-b7ff-ff6994d9b6d5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [fa32bd44-98c9-4305-b0b7-097803e297cb] AMQP server on 10.222.0.37:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 15 04:32:29.964159 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [None req-663d0208-e105-44f9-b7ff-ff6994d9b6d5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] [fa32bd44-98c9-4305-b0b7-097803e297cb] Reconnected to AMQP server on 10.222.0.37:5672 via [amqp] client with port 50448. Sep 15 04:32:29.983909 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO nova.api.openstack.requestlog [None req-663d0208-e105-44f9-b7ff-ff6994d9b6d5 tempest-TestVolumeBootPattern-1636689690 tempest-TestVolumeBootPattern-1636689690-project] 10.222.0.37 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-460250898" status: 202 len: 0 microversion: 2.1 time: 1.044898 Sep 15 04:32:29.984482 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: [pid: 108181|app: 0|req: 546/1127] 10.222.0.37 () {58 vars in 1260 bytes} [Wed Sep 15 04:32:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-460250898 => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 15 04:32:49.432423 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:32:49.433235 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: Wed Sep 15 04:32:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:34:43.309668 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:34:43.310370 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: Wed Sep 15 04:34:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:35:58.845667 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:35:58.846236 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: Wed Sep 15 04:35:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:36:09.451921 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:36:09.452452 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: Wed Sep 15 04:36:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:37:45.343865 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:37:45.344338 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: Wed Sep 15 04:37:45 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:37:55.646428 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:37:55.647015 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: Wed Sep 15 04:37:55 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:38:03.327676 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:38:03.328332 dv-cinder-760153-12-iscsi devstack@n-api.service[108182]: Wed Sep 15 04:38:03 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 15 04:38:05.438377 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 15 04:38:05.439105 dv-cinder-760153-12-iscsi devstack@n-api.service[108181]: Wed Sep 15 04:38:05 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!